-- Logs begin at Fri 2022-07-15 14:50:37 UTC, end at Fri 2022-07-15 15:56:26 UTC. -- Jul 15 15:29:30.758209 dv-osbrick-849840-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 15:29:30.765817 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 15:29:30 2022] *** Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: nodename: dv-osbrick-849840-2-ceph Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: machine: x86_64 Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: clock source: unix Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: pcre jit disabled Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: detected number of CPU cores: 4 Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: current working directory: / Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: detected binary path: /usr/bin/uwsgi-core Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: your processes number limit is 47680 Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: your memory page size is 4096 bytes Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: detected max file descriptor number: 2048 Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: lock engine: pthread robust mutexes Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: thunder lock: enabled Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 15:29:30.773239 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 15:29:30.814563 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: Python main interpreter initialized at 0x55d1d61eb9c0 Jul 15 15:29:30.814563 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: python threads support enabled Jul 15 15:29:30.814563 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: your server socket listen backlog is limited to 100 connections Jul 15 15:29:30.814563 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: your mercy for graceful operations on workers is 90 seconds Jul 15 15:29:30.814906 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 15:29:30.814980 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: *** Operational MODE: preforking *** Jul 15 15:29:30.815229 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: *** uWSGI is running in multiple interpreter mode *** Jul 15 15:29:30.815229 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: spawned uWSGI master process (pid: 87235) Jul 15 15:29:30.815432 dv-osbrick-849840-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 15 15:29:30.816574 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: spawned uWSGI worker 1 (pid: 87247, cores: 1) Jul 15 15:29:30.816574 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: spawned uWSGI worker 2 (pid: 87248, cores: 1) Jul 15 15:29:30.816574 dv-osbrick-849840-2-ceph devstack@keystone.service[87235]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 15:29:36.531853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:29:36.531853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: from cryptography.utils import int_from_bytes Jul 15 15:29:36.532679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:29:36.532679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: from cryptography.utils import int_from_bytes Jul 15 15:29:36.533113 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:29:36.533113 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: from cryptography.utils import int_from_bytes Jul 15 15:29:36.533245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 15:29:36.533245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: from cryptography.utils import int_from_bytes Jul 15 15:29:36.580797 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:29:36.581001 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:29:36.581092 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 15:29:36.581179 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] command line args: [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:29:36.581251 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 15:29:36.581423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] command line args: [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 15:29:36.581501 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:29:36.581605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ================================================================================ {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:29:36.581689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 15:29:36.581860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] admin_token = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.581944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ================================================================================ {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 15:29:36.582105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] config_dir = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] admin_token = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582376 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] config_dir = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582475 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] config_source = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582551 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582655 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] debug = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582733 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] config_source = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.582855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] debug = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583503 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583606 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583708 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.583963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584059 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584154 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584254 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] list_limit = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] list_limit = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584466 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] log_config_append = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584569 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] log_config_append = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.584876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585000 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] log_dir = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585125 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] log_dir = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] log_file = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585340 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] log_file = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585415 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585537 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585612 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.585881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586087 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586166 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586284 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586372 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586500 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586694 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.586971 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587251 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587321 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587593 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587672 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.587943 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.588103 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.588182 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.588386 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.588645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.94/identity {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.588851 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] publish_errors = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.588977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.94/identity {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] publish_errors = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589350 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589690 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589690 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.589883 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590008 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590095 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590167 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590276 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] standard_threads = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590349 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] standard_threads = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590684 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590829 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] use_journal = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.590998 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591082 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] use_json = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591182 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] use_journal = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591260 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] use_stderr = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591367 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] use_json = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] use_syslog = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591526 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] use_stderr = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] use_syslog = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.591876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.591964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 15:29:36.592117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.592232 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.592378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.592489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.592618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.592757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.592866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.592964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593340 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593417 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593806 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.593877 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.594062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.594138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.594329 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.594445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.595085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.595170 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.595333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.595467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.595592 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.595707 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.595893 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596257 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.596960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597563 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597677 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597796 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.597921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598148 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598380 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598493 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598615 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.598964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599425 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599544 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599658 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.599947 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600071 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600185 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600762 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600878 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.600991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601226 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601470 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601704 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.601931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.602044 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.602316 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.602433 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.602547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.602666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.602770 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.602882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603003 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603118 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603700 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.603976 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604319 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604319 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.604920 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605038 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605162 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605277 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605396 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605511 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605624 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.605900 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606023 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606382 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606503 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.606858 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607122 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607236 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607591 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607875 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.607985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608343 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608588 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608705 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.608933 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609176 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609292 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609406 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609521 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609755 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.609879 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.610505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.610654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.610807 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.610922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611275 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611389 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611793 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.611913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612149 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612262 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612384 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612748 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612868 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.612983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613649 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.613886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614002 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614002 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614216 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614330 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.614987 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.615103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.615224 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.615348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.615473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.615600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.615726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.615874 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616313 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616599 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616832 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.616946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617061 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617310 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617426 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617541 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617655 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617769 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.617897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618248 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] auth.external = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618716 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.618952 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.619066 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.619189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] auth.external = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.619333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] auth.password = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.619459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.619591 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] auth.token = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.619816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.619939 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620055 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] auth.password = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620423 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620538 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] auth.token = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620661 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620778 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.620894 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621136 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621257 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] credential.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621728 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.621960 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622192 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622440 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] credential.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622557 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622672 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.622902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623024 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623267 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.623911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624029 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624261 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624490 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624845 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.624966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.625082 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.625199 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.625322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.625451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.625451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.625720 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.626374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.626507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.626634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.626751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.626866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.626981 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627213 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627686 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627838 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.627956 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628083 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628553 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628793 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.628910 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629025 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629370 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629559 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629783 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.629886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630000 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630123 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630573 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630920 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.630920 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631136 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631490 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.631974 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632223 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632341 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632457 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632694 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632811 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.632811 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633433 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633748 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.633981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634096 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634566 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634798 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.634913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635027 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635267 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635499 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635622 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635769 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.635900 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.636018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.636137 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.636252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.636375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.636748 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.636874 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.636990 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637589 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.637944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638419 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638649 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.638881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639350 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.639891 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640006 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640121 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640351 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640812 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.640928 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641042 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641178 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641341 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641808 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.641932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642056 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642288 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642403 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642643 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.642990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.643105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.643228 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.643345 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.643460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.643576 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.643763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.643885 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644250 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644364 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644480 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644594 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644718 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.644951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645065 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645182 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645423 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645541 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645656 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645771 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.645886 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646124 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646242 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646462 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646576 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646691 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.646931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.647047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.647187 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.647340 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.647458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.647582 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.647700 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.647897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648267 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648396 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648515 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648630 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648746 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.648977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649219 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649565 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649680 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.649922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650037 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650383 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650625 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650855 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.650970 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651085 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651558 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.651977 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652096 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] role.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652559 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652748 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] role.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652748 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.652969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653565 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653680 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.653911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654026 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] role.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654267 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654383 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] role.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654497 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654729 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.654970 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655086 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655676 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.655923 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656385 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656500 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.656992 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657223 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657338 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657699 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657699 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.657917 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658395 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658626 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658858 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.658982 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659215 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659330 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659445 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659826 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.659943 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660300 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660419 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660763 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.660882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661006 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661569 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661809 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.661925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662040 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662040 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662378 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662610 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662840 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.662956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663080 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663413 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.663919 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664036 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664152 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664267 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664505 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664738 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.connection = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664862 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.664987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665106 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665335 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665811 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.665926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666040 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666168 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666402 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666747 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.connection = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.666875 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667239 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667354 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667707 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.667961 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668438 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668671 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.668786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669003 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.669245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 15:29:36.670173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87247) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 15:29:36.696278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.696500 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.696722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.697454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.697689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.697921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.705819 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.707106 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.733837 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.734063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.735310 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.735548 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.786958 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.788222 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.837451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.837677 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.838083 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.838323 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.902611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.902835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903122 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.903845 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.904067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.904285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.927993 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928219 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928334 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928572 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.928943 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.929073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.929153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.929284 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.929364 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.929498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.942317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.942721 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.954987 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955100 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955204 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955798 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.955913 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.956021 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.956128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.956235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.956341 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87247) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.956435 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87248) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 15:29:36.974190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.974273 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.974348 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:29:36.974439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:29:36.974612 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.974756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.974838 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:29:36.974960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 15:29:36.975076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.975235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.975372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.975491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.975574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.975764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.975861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.976013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.986957 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.987043 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.987229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.987310 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.987493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.987576 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.987787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.987873 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.995848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:36.995963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:36.999097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:36.999236 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:36.999375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.999498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.999640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.999803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:36.999949 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.000090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.000231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.000377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.000470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.001151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.001358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.001531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.001637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.001815 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.001896 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.002091 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.002171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.002372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.002460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.002646 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.029461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.029796 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.031201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.031476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.031560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.031887 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.037111 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.037217 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.037347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.037475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.037626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.037757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.044975 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.045069 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.045252 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.045335 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.049731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.049876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.050131 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.050279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.050413 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.050568 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.050695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.050855 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.050969 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.051137 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.051242 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.051419 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.051499 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.051693 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.051805 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.051994 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.070549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.070823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.071073 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.071355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.075409 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.076063 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.079067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.079357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.079847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.080149 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.084316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.085183 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.087889 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.088843 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.091575 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.091898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.092183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.092466 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.092660 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.092754 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.092964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.093047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.093254 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.093543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.093827 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.094128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.112610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.112904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.113170 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.113430 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.113676 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.113971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.114241 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.114509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.121343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.122520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.123054 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.123329 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.124269 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.124550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.126884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.127159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.127437 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.127725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.128039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.128166 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.128449 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.128736 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.129021 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.129316 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.141724 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.141996 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.142273 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.142551 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.142831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.143012 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.143095 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.143294 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.143382 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.143577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.143885 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.144171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.144449 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.144737 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.161768 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.162969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.165017 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.166250 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.168310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.169605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.169904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.171235 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.171518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.171818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.172097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.173407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.173687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.173969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.180502 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.181416 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.181652 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.183047 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.184866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.185153 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.185451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.185724 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.186299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.186592 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.186882 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.187165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.194856 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.195133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.196342 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.196474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.196631 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.197971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.204824 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87248) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.205094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.205373 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.205644 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.205911 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.206188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.206427 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87247) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 15:29:37.206521 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.206708 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.206788 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.206968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.207047 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.207233 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.207350 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.207513 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.207611 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.207767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.207848 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.208046 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.208126 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.208303 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87248) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.208395 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.208615 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.208886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.209174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.209450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.209735 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.210001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87247) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 15:29:37.246454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d1d61eb9c0 pid: 87248 (default app) Jul 15 15:29:37.249679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d1d61eb9c0 pid: 87247 (default app) Jul 15 15:29:37.249774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffa965-3fec-43c4-bd70-83d49670d831 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:37.249983 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffa965-3fec-43c4-bd70-83d49670d831 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:37.250264 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffa965-3fec-43c4-bd70-83d49670d831 None None] PATH_INFO: `/v3` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:37.254555 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 1/1] 10.222.0.94 () {50 vars in 791 bytes} [Fri Jul 15 15:29:37 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:29:45.250784 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132d7f1-51cf-499e-8d50-cdb8109e5f78 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:45.251328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132d7f1-51cf-499e-8d50-cdb8109e5f78 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:45.251328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132d7f1-51cf-499e-8d50-cdb8109e5f78 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:45.255750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 1/2] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:45.261385 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:45.261808 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:45.261942 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:45.339328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: INFO dbcounter [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] Registered counter for database keystone Jul 15 15:29:45.360406 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG oslo_db.sqlalchemy.engines [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:29:45.366586 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writer thread running {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:29:45.542939 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG passlib.handlers.bcrypt [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87248) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 15:29:45.543289 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG passlib.handlers.bcrypt [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87248) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 15:29:45.598377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:45.600028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:45.724232 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 2/3] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 15:29:45.867172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132d7f1-51cf-499e-8d50-cdb8109e5f78 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:45.946683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: INFO dbcounter [None req-3132d7f1-51cf-499e-8d50-cdb8109e5f78 None None] Registered counter for database keystone Jul 15 15:29:45.967146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG oslo_db.sqlalchemy.engines [None req-3132d7f1-51cf-499e-8d50-cdb8109e5f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87247) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 15:29:45.973640 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writer thread running {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 15:29:46.092773 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132d7f1-51cf-499e-8d50-cdb8109e5f78 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:46.097223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdaf0c-3905-4642-a884-1741e61b6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:46.097886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdaf0c-3905-4642-a884-1741e61b6540 admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:46.098178 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdaf0c-3905-4642-a884-1741e61b6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:46.098462 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdaf0c-3905-4642-a884-1741e61b6540 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:46.106933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdaf0c-3905-4642-a884-1741e61b6540 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:46.158322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1bdaf0c-3905-4642-a884-1741e61b6540 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 15:29:46.158608 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdaf0c-3905-4642-a884-1741e61b6540 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:46.168327 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 2/4] 10.222.0.94 () {58 vars in 1324 bytes} [Fri Jul 15 15:29:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:29:46.174732 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:46.189509 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598f86-de24-422c-82ee-09b8845a1f9c None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:46.194080 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969285a-4bd3-4eaf-b5bc-53fac8f54244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:46.195189 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969285a-4bd3-4eaf-b5bc-53fac8f54244 admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:46.195481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969285a-4bd3-4eaf-b5bc-53fac8f54244 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:46.195815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969285a-4bd3-4eaf-b5bc-53fac8f54244 admin admin] PATH_INFO: `/v3/projects/0448cce79e4a43eab947a52177358b0b` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:46.197421 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969285a-4bd3-4eaf-b5bc-53fac8f54244 admin admin] RBAC: Authorizing `identity:get_project(project_id=0448cce79e4a43eab947a52177358b0b)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:46.250946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b969285a-4bd3-4eaf-b5bc-53fac8f54244 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 15:29:46.251298 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969285a-4bd3-4eaf-b5bc-53fac8f54244 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:46.256006 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 3/5] 10.222.0.94 () {56 vars in 1207 bytes} [Fri Jul 15 15:29:46 2022] GET /identity/v3/projects/0448cce79e4a43eab947a52177358b0b => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:29:48.469853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a62bd8-b28a-4326-a4f8-c01e111efe21 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:48.470389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a62bd8-b28a-4326-a4f8-c01e111efe21 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:48.470389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a62bd8-b28a-4326-a4f8-c01e111efe21 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:48.475177 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 3/6] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:48.480725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac84bc-3094-483d-8038-14e8b7ba809d None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:48.481164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac84bc-3094-483d-8038-14e8b7ba809d None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:48.481299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac84bc-3094-483d-8038-14e8b7ba809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:48.499981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-2cac84bc-3094-483d-8038-14e8b7ba809d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:48.501519 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-2cac84bc-3094-483d-8038-14e8b7ba809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:48.509483 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 4/7] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 15:29:48.533659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a62bd8-b28a-4326-a4f8-c01e111efe21 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:48.545855 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a62bd8-b28a-4326-a4f8-c01e111efe21 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:48.550156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7bf07-6cb8-4e73-8993-31340967ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:48.550791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7bf07-6cb8-4e73-8993-31340967ba5c admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:48.551081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7bf07-6cb8-4e73-8993-31340967ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:48.551363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7bf07-6cb8-4e73-8993-31340967ba5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:48.559159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7bf07-6cb8-4e73-8993-31340967ba5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:48.560972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7bf07-6cb8-4e73-8993-31340967ba5c admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:48.569907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 4/8] 10.222.0.94 () {58 vars in 1324 bytes} [Fri Jul 15 15:29:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 15:29:48.575107 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac84bc-3094-483d-8038-14e8b7ba809d None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:48.584692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac84bc-3094-483d-8038-14e8b7ba809d None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:48.589132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668c5e2-2187-4401-a5a5-3dec2768da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:48.589991 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c5e2-2187-4401-a5a5-3dec2768da1e admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:48.590282 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c5e2-2187-4401-a5a5-3dec2768da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:48.590566 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668c5e2-2187-4401-a5a5-3dec2768da1e admin admin] PATH_INFO: `/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:48.591985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c5e2-2187-4401-a5a5-3dec2768da1e admin admin] RBAC: Authorizing `identity:get_user(user_id=1a5c2341cb2b4b2f93d951457ae1d5c4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:48.594344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668c5e2-2187-4401-a5a5-3dec2768da1e admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:48.595944 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 5/9] 10.222.0.94 () {56 vars in 1198 bytes} [Fri Jul 15 15:29:48 2022] GET /identity/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:29:50.894485 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504bfd6-5f5b-43d3-90b8-bd0d25cec34b None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:50.894991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504bfd6-5f5b-43d3-90b8-bd0d25cec34b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:50.895070 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504bfd6-5f5b-43d3-90b8-bd0d25cec34b None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:50.896652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 5/10] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:50.902087 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927f637-5279-4057-ab41-f8b3b3a95add None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:50.902530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927f637-5279-4057-ab41-f8b3b3a95add None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:50.902651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927f637-5279-4057-ab41-f8b3b3a95add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:50.904132 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d2fe2-abf1-491c-b78f-519d27afc493 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:50.904434 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d2fe2-abf1-491c-b78f-519d27afc493 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:50.904721 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d2fe2-abf1-491c-b78f-519d27afc493 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:50.906607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 6/11] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:29:50.912042 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:50.912339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:50.912625 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:50.920335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6927f637-5279-4057-ab41-f8b3b3a95add None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:50.921556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6927f637-5279-4057-ab41-f8b3b3a95add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:50.953792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG passlib.handlers.bcrypt [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87247) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 15:29:50.954238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG passlib.handlers.bcrypt [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87247) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 15:29:51.000108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:51.001702 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:51.003765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 6/12] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:29:51.026802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927f637-5279-4057-ab41-f8b3b3a95add None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.051030 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:51.104717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 7/13] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:29:51.129328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.239807 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2ab5-e88f-4810-a995-bd6467991506 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:51.241170 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927f637-5279-4057-ab41-f8b3b3a95add None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:51.242097 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:51.275449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:51.276137 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:51.276432 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:51.276718 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:51.279686 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:51.280779 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:51.281073 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:51.281355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:51.293056 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:29:51.304231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:29:51.305319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:29:51.306329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 8/14] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:29:51.311191 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.347528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:51.349921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:51.372666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:51.409824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e05c6-3670-4463-869f-93f08259dd4e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:51.443490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:51.444188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:51.444472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:51.444761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:51.445514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:29:51.445819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:51.447245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:51.448169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 7/15] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:29:51.454218 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.459790 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 9/16] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:51.465153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.491706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:51.551960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f848ec-79fc-4a03-b85e-8c87333dea5e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:51.564465 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53528c-0f7b-4748-908a-bca81d1b33cf None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:51.574211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:51.586641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:51.587439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:51.587763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:51.588048 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:51.598865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:51.599002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:51.599791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:51.600089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:51.600370 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] PATH_INFO: `/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:51.600482 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:51.601923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] RBAC: Authorizing `identity:get_user(user_id=1a5c2341cb2b4b2f93d951457ae1d5c4)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:51.603363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:51.605055 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 10/17] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:51.610550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:29:51.621401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:29:51.622291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:29:51.623103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:29:51.623103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:29:51.623103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:29:51.623103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:29:51.623103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 8/18] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:29:51.628308 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.707142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:51.713867 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d048a-407c-4e86-8ffa-2c6bf72a69ed None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:51.730258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4786b-fa78-4c05-a23a-9da9f6de8fdf None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:51.746827 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:51.747552 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:51.747870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:51.748157 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:51.749344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:51.750862 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:51.752494 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 11/19] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:51.758408 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:51.765871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade8a4f-d0de-47f7-a2e5-6cf788fbf9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:51.766539 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade8a4f-d0de-47f7-a2e5-6cf788fbf9d4 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:51.766827 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade8a4f-d0de-47f7-a2e5-6cf788fbf9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:51.767102 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade8a4f-d0de-47f7-a2e5-6cf788fbf9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:51.767868 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade8a4f-d0de-47f7-a2e5-6cf788fbf9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:29:51.768180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade8a4f-d0de-47f7-a2e5-6cf788fbf9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:51.769619 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade8a4f-d0de-47f7-a2e5-6cf788fbf9d4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:51.790678 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 9/20] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:51.974490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276407b-fc17-4733-a52e-a23a91a2f8f9 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:52.009492 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208b750-4b07-4873-9f4c-a6e80ca81bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:52.010089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b750-4b07-4873-9f4c-a6e80ca81bcc None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:52.010377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b750-4b07-4873-9f4c-a6e80ca81bcc None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:52.010920 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b750-4b07-4873-9f4c-a6e80ca81bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:52.011782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208b750-4b07-4873-9f4c-a6e80ca81bcc None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.domain.id=default, user.id=1a5c2341cb2b4b2f93d951457ae1d5c4) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:29:52.012107 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208b750-4b07-4873-9f4c-a6e80ca81bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:52.013555 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208b750-4b07-4873-9f4c-a6e80ca81bcc None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:52.022066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 12/21] 10.222.0.94 () {56 vars in 1322 bytes} [Fri Jul 15 15:29:51 2022] GET /identity/v3/role_assignments?user.id=1a5c2341cb2b4b2f93d951457ae1d5c4&scope.domain.id=default&role.id=8442e7332b934407beff8c3564575b62 => generated 233 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:54.497917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c58ff1-b777-4e0c-8787-a72278d00a58 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:54.499032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c58ff1-b777-4e0c-8787-a72278d00a58 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:54.500101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c58ff1-b777-4e0c-8787-a72278d00a58 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:54.501982 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 10/22] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:54.507155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e8403-f64e-42a4-bdb3-d35618cf66d7 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:54.508156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e8403-f64e-42a4-bdb3-d35618cf66d7 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:54.508643 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e8403-f64e-42a4-bdb3-d35618cf66d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:54.532923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-a03e8403-f64e-42a4-bdb3-d35618cf66d7 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:54.534478 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-a03e8403-f64e-42a4-bdb3-d35618cf66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:54.564259 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:54.628064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 13/23] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:29:54.664495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c58ff1-b777-4e0c-8787-a72278d00a58 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:54.716389 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:54.807961 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c58ff1-b777-4e0c-8787-a72278d00a58 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:54.809041 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054949-fe63-4ef8-81a3-68a6ed3469dd None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:54.809628 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054949-fe63-4ef8-81a3-68a6ed3469dd None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:54.810120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054949-fe63-4ef8-81a3-68a6ed3469dd None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:54.815895 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 14/24] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:54.817377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb932-c5a2-4af7-a539-b5dc50584663 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:54.817868 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb932-c5a2-4af7-a539-b5dc50584663 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:54.818344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb932-c5a2-4af7-a539-b5dc50584663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:54.858184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:54.859673 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:54.860012 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:54.860257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:54.876859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-eaccb932-c5a2-4af7-a539-b5dc50584663 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:54.878383 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-eaccb932-c5a2-4af7-a539-b5dc50584663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:54.879550 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:54.883762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:29:54.911307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:29:54.912229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:29:54.913028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:29:54.913028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:29:54.913028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:29:54.913028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:29:54.915310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 11/25] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:29:54.921798 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:55.033160 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 15/26] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:29:55.034574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce40ce-6904-40ed-81c5-e4188d71f36f None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.034919 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce40ce-6904-40ed-81c5-e4188d71f36f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.035211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce40ce-6904-40ed-81c5-e4188d71f36f None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.042050 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 16/27] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:55.058659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5794-15b1-49ae-ac40-35b77a454639 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.059123 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5794-15b1-49ae-ac40-35b77a454639 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.059557 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab5794-15b1-49ae-ac40-35b77a454639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.106428 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-6dab5794-15b1-49ae-ac40-35b77a454639 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:55.107949 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-6dab5794-15b1-49ae-ac40-35b77a454639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:55.136083 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:55.156302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2269f1-24bf-469a-809c-95230d955109 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:55.218723 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb592f3-3220-4e45-888f-55533b5e8d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:55.219712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb592f3-3220-4e45-888f-55533b5e8d0f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.221246 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb592f3-3220-4e45-888f-55533b5e8d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.221679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb592f3-3220-4e45-888f-55533b5e8d0f None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.222551 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb592f3-3220-4e45-888f-55533b5e8d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:29:55.223674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb592f3-3220-4e45-888f-55533b5e8d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:55.225871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb592f3-3220-4e45-888f-55533b5e8d0f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:55.239618 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 17/28] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:29:55.240658 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5794-15b1-49ae-ac40-35b77a454639 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:55.262210 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 12/29] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:29:55.265275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc80bf8-3ef7-4114-ba89-c099e5db4cbd None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.265579 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc80bf8-3ef7-4114-ba89-c099e5db4cbd None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.265865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc80bf8-3ef7-4114-ba89-c099e5db4cbd None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.267157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 13/30] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:29:55.270013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc80bf8-3ef7-4114-ba89-c099e5db4cbd None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:55.281639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:55.385733 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc80bf8-3ef7-4114-ba89-c099e5db4cbd None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:55.394502 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab5794-15b1-49ae-ac40-35b77a454639 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:55.424422 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:55.425422 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.425887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.426343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.427263 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:55.429022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:55.436959 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4908a0-d1e4-44a0-a8d0-41b68df3adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:55.437645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4908a0-d1e4-44a0-a8d0-41b68df3adff None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.437936 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4908a0-d1e4-44a0-a8d0-41b68df3adff None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.438219 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4908a0-d1e4-44a0-a8d0-41b68df3adff None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.438973 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4908a0-d1e4-44a0-a8d0-41b68df3adff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:55.440868 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4908a0-d1e4-44a0-a8d0-41b68df3adff None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:55.459867 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:55.574711 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 18/31] 10.222.0.94 () {60 vars in 1131 bytes} [Fri Jul 15 15:29:55 2022] POST /identity/v3/roles => generated 219 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:29:55.576095 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9edcd-b771-4bf0-a4b4-37664fabea49 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.576400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9edcd-b771-4bf0-a4b4-37664fabea49 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.576706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9edcd-b771-4bf0-a4b4-37664fabea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.587028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 14/32] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:29:55 2022] POST /identity/v3/projects => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:29:55.592522 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:55.612597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-90f9edcd-b771-4bf0-a4b4-37664fabea49 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:55.614259 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-90f9edcd-b771-4bf0-a4b4-37664fabea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:55.794570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 19/33] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:29:55.836329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9edcd-b771-4bf0-a4b4-37664fabea49 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:55.840524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b0afe-e671-4377-b8df-50d1340a870c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:55.854751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:55.897092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:55.897914 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:55.898204 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:55.898483 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:55.917437 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:29:55.928472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:29:55.929344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:29:55.930278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 15/34] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:29:55.939359 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:55.986453 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9edcd-b771-4bf0-a4b4-37664fabea49 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.030490 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:56.038254 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15f4e2-6915-4277-b12a-74ab035a2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.039282 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f4e2-6915-4277-b12a-74ab035a2f58 None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.039843 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f4e2-6915-4277-b12a-74ab035a2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.040344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15f4e2-6915-4277-b12a-74ab035a2f58 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.041439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15f4e2-6915-4277-b12a-74ab035a2f58 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.043164 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15f4e2-6915-4277-b12a-74ab035a2f58 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.058901 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 20/35] 10.222.0.94 () {60 vars in 1131 bytes} [Fri Jul 15 15:29:55 2022] POST /identity/v3/roles => generated 225 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:29:56.087600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a91c0d-6a68-4cb1-acc0-7f844ce6e954 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.141210 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.142274 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.142764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.143319 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.144436 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:29:56.144979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.146753 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.161640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 16/36] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:56.167357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:56.168263 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c64c2-419f-4efd-bdba-59a75dee47a9 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.168831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c64c2-419f-4efd-bdba-59a75dee47a9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.169321 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c64c2-419f-4efd-bdba-59a75dee47a9 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.172078 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 21/37] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:56.174681 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970548a-b4ba-47c9-87cd-b08f9e33eca1 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.175247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970548a-b4ba-47c9-87cd-b08f9e33eca1 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.175726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970548a-b4ba-47c9-87cd-b08f9e33eca1 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.177876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 22/38] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:56.180172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f699a8-5f4a-4796-9550-977c1a7ceb09 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.181173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f699a8-5f4a-4796-9550-977c1a7ceb09 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.181657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f699a8-5f4a-4796-9550-977c1a7ceb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.206193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-b2f699a8-5f4a-4796-9550-977c1a7ceb09 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:56.209259 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-b2f699a8-5f4a-4796-9550-977c1a7ceb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:56.281853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4c11-d355-4e85-8458-85e93d950764 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.284902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:56.294982 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 23/39] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:29:56.296707 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a66d-9b6b-4693-8987-19b54a795900 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.297005 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a66d-9b6b-4693-8987-19b54a795900 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.297279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a66d-9b6b-4693-8987-19b54a795900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.308425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:56.315508 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-0441a66d-9b6b-4693-8987-19b54a795900 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:56.316673 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-0441a66d-9b6b-4693-8987-19b54a795900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:56.333897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.334789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.335083 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.335375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] PATH_INFO: `/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.336738 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5c2341cb2b4b2f93d951457ae1d5c4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.338208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.339893 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 17/40] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:29:56 2022] GET /identity/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:56.340647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:56.386819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 24/41] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:29:56.387461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a66d-9b6b-4693-8987-19b54a795900 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:56.444375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8276a7-1b96-4c9e-ac5d-8b3f0f71a3f4 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.480074 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91842220-22da-458e-8b60-084c6897476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.480775 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91842220-22da-458e-8b60-084c6897476a None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.481090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91842220-22da-458e-8b60-084c6897476a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.481375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91842220-22da-458e-8b60-084c6897476a None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.482135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91842220-22da-458e-8b60-084c6897476a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.483618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91842220-22da-458e-8b60-084c6897476a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.488587 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a66d-9b6b-4693-8987-19b54a795900 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.498125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 18/42] 10.222.0.94 () {60 vars in 1131 bytes} [Fri Jul 15 15:29:56 2022] POST /identity/v3/roles => generated 223 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:29:56.498946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91842220-22da-458e-8b60-084c6897476a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:56.533026 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:56.542856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.543677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.544004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.544291 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.545525 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.547096 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.549006 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 25/43] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:29:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:29:56.554804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:56.560035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:56.622251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91842220-22da-458e-8b60-084c6897476a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.661131 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.662063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.662359 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.662645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.664727 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.666207 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.667899 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 19/44] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:29:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:29:56.672960 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af4fc-6bff-4041-9434-276b347f4b0d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.674010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:56.721713 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a4f4f-5be7-43f9-b689-f32c5bcf5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.722644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a4f4f-5be7-43f9-b689-f32c5bcf5392 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.722937 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a4f4f-5be7-43f9-b689-f32c5bcf5392 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.723230 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a4f4f-5be7-43f9-b689-f32c5bcf5392 None admin] PATH_INFO: `/v3/domains/default/users/1a5c2341cb2b4b2f93d951457ae1d5c4/roles/8442e7332b934407beff8c3564575b62` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.725400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a4f4f-5be7-43f9-b689-f32c5bcf5392 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1a5c2341cb2b4b2f93d951457ae1d5c4, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.726853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a4f4f-5be7-43f9-b689-f32c5bcf5392 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.743123 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 26/45] 10.222.0.94 () {58 vars in 1361 bytes} [Fri Jul 15 15:29:56 2022] PUT /identity/v3/domains/default/users/1a5c2341cb2b4b2f93d951457ae1d5c4/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:29:56.787000 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f84c6-739a-42ff-98ac-7610b991d7d0 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:56.805499 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:56.824820 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e8405-7b6c-4dbe-990e-4b5847507f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:56.825505 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8405-7b6c-4dbe-990e-4b5847507f03 None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:56.825801 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8405-7b6c-4dbe-990e-4b5847507f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:56.826091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8405-7b6c-4dbe-990e-4b5847507f03 None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:56.826827 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e8405-7b6c-4dbe-990e-4b5847507f03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:56.828432 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e8405-7b6c-4dbe-990e-4b5847507f03 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:56.855713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 20/46] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:29:56 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:29:58.951607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304d6c5-0b47-46b6-9b7a-69b5e86c26de None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:58.952681 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304d6c5-0b47-46b6-9b7a-69b5e86c26de None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:58.952762 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304d6c5-0b47-46b6-9b7a-69b5e86c26de None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:58.954185 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 27/47] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:29:58.960174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b07c-8968-4a45-9897-85e612982760 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:58.960655 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b07c-8968-4a45-9897-85e612982760 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:58.960801 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b07c-8968-4a45-9897-85e612982760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:58.978986 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-df62b07c-8968-4a45-9897-85e612982760 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:58.980560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-df62b07c-8968-4a45-9897-85e612982760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:59.051703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 21/48] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:29:59.075832 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304d6c5-0b47-46b6-9b7a-69b5e86c26de None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:59.102049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cddae1-12e2-411c-888b-b6605872613b None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.102434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cddae1-12e2-411c-888b-b6605872613b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.102791 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cddae1-12e2-411c-888b-b6605872613b None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.104211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 22/49] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:29:59.109795 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709359-6478-47f6-9aac-d3e59bebe97f None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.110089 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709359-6478-47f6-9aac-d3e59bebe97f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.110395 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709359-6478-47f6-9aac-d3e59bebe97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.127324 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-69709359-6478-47f6-9aac-d3e59bebe97f None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:29:59.128567 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-69709359-6478-47f6-9aac-d3e59bebe97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:29:59.134002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:59.181967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304d6c5-0b47-46b6-9b7a-69b5e86c26de None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:59.195392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 23/50] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:29:59.216099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:59.216844 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.217135 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.217421 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.218966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709359-6478-47f6-9aac-d3e59bebe97f None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:59.227790 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:29:59.236010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:29:59.236830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:29:59.237586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 28/51] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:29:59.242947 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:59.246154 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:59.320177 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709359-6478-47f6-9aac-d3e59bebe97f None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:59.342514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6323-91eb-4ffc-ab8c-3bbb2255d1d7 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:59.354088 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:59.354890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.355187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.355473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.356703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:59.357537 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:59.358203 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:59.360455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 24/52] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:29:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:59.365905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:59.381422 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:59.382124 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.382413 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.382792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.383893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:29:59.384365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:59.386651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:59.395372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 29/53] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:59.400899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:59.461169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:59.468186 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3504b7-49c7-4758-8108-abf381193671 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:59.501128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6afe1-7ad2-4417-8ac9-667648ab0412 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:59.502089 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:59.502749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.503034 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.503317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.504073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:59.505518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:59.530708 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 25/54] 10.222.0.94 () {60 vars in 1140 bytes} [Fri Jul 15 15:29:59 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:29:59.534897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:59.535819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.536116 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.536389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] PATH_INFO: `/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.537680 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] RBAC: Authorizing `identity:get_user(user_id=1a5c2341cb2b4b2f93d951457ae1d5c4)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:59.539179 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:59.540933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 30/55] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:29:59 2022] GET /identity/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:29:59.547332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:59.652754 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67549-06f0-44f9-9627-4a66cb0d6d9a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:59.687730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a57ac5-926a-42a2-aaaf-6a66dbc496d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:59.688557 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57ac5-926a-42a2-aaaf-6a66dbc496d2 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.688847 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57ac5-926a-42a2-aaaf-6a66dbc496d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.689125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a57ac5-926a-42a2-aaaf-6a66dbc496d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.690315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a57ac5-926a-42a2-aaaf-6a66dbc496d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:59.691787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a57ac5-926a-42a2-aaaf-6a66dbc496d2 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:59.693504 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 26/56] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:29:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:29:59.699339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:29:59.748813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:29:59.806145 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6635b-b808-4f1d-a779-fdf7104f703a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:29:59.839223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fef7e-b763-4452-bc6c-20178779b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:29:59.839933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fef7e-b763-4452-bc6c-20178779b075 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:29:59.840223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fef7e-b763-4452-bc6c-20178779b075 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:29:59.840506 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fef7e-b763-4452-bc6c-20178779b075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:29:59.841332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fef7e-b763-4452-bc6c-20178779b075 None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.domain.id=default, user.id=1a5c2341cb2b4b2f93d951457ae1d5c4) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:29:59.841650 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fef7e-b763-4452-bc6c-20178779b075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:29:59.843707 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fef7e-b763-4452-bc6c-20178779b075 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:29:59.849475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 31/57] 10.222.0.94 () {56 vars in 1322 bytes} [Fri Jul 15 15:29:59 2022] GET /identity/v3/role_assignments?user.id=1a5c2341cb2b4b2f93d951457ae1d5c4&scope.domain.id=default&role.id=8442e7332b934407beff8c3564575b62 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:01.769713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d1e0-e4ca-41ad-aa2e-5e38a937985e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:01.770227 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d1e0-e4ca-41ad-aa2e-5e38a937985e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:01.770340 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d1e0-e4ca-41ad-aa2e-5e38a937985e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:01.771781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 27/58] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:01.776951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eec40c-d816-4e2b-aaa4-3850be448a9d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:01.777312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eec40c-d816-4e2b-aaa4-3850be448a9d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:01.777531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eec40c-d816-4e2b-aaa4-3850be448a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:01.794543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-95eec40c-d816-4e2b-aaa4-3850be448a9d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:01.796366 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-95eec40c-d816-4e2b-aaa4-3850be448a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:01.861908 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 32/59] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:01.887228 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d1e0-e4ca-41ad-aa2e-5e38a937985e None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:01.906970 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:01.991325 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d1e0-e4ca-41ad-aa2e-5e38a937985e None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:02.024358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b4a59-754a-48cd-886b-45454104fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:02.025078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4a59-754a-48cd-886b-45454104fb58 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:02.025366 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4a59-754a-48cd-886b-45454104fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:02.025648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b4a59-754a-48cd-886b-45454104fb58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:02.026818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b4a59-754a-48cd-886b-45454104fb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:02.028291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b4a59-754a-48cd-886b-45454104fb58 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:02.029885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 28/60] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:02.035445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eec40c-d816-4e2b-aaa4-3850be448a9d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:02.075365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:02.134055 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eec40c-d816-4e2b-aaa4-3850be448a9d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:02.166788 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794c1c4-5fe5-48b3-903d-23d429b48f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:02.167455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c1c4-5fe5-48b3-903d-23d429b48f0d None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:02.167773 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c1c4-5fe5-48b3-903d-23d429b48f0d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:02.168062 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c1c4-5fe5-48b3-903d-23d429b48f0d None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:02.169046 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794c1c4-5fe5-48b3-903d-23d429b48f0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:02.171050 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794c1c4-5fe5-48b3-903d-23d429b48f0d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:02.197445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 33/61] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:30:02 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:30:05.532247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6f0a-d11e-4327-befc-9713ad690a18 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:05.532809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6f0a-d11e-4327-befc-9713ad690a18 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:05.532809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d6f0a-d11e-4327-befc-9713ad690a18 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:05.534587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 29/62] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:05.539903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb60a1-dcfb-44f2-be30-fd6b6f77c894 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:05.540830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb60a1-dcfb-44f2-be30-fd6b6f77c894 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:05.541337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb60a1-dcfb-44f2-be30-fd6b6f77c894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:05.573045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-d1bb60a1-dcfb-44f2-be30-fd6b6f77c894 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:05.574652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-d1bb60a1-dcfb-44f2-be30-fd6b6f77c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:05.669671 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 34/63] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:05.712199 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d6f0a-d11e-4327-befc-9713ad690a18 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:05.725906 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537c01-7531-4705-a9d3-59ea0df0a280 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:05.726518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537c01-7531-4705-a9d3-59ea0df0a280 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:05.727044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537c01-7531-4705-a9d3-59ea0df0a280 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:05.728475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 35/64] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:05.729789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdc5dd-952b-4ac6-936d-508b5c7eb184 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:05.730300 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdc5dd-952b-4ac6-936d-508b5c7eb184 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:05.730782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdc5dd-952b-4ac6-936d-508b5c7eb184 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:05.732565 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 36/65] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:05.737370 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c1ee2-f556-44e9-a8bb-85203d84e785 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:05.737931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c1ee2-f556-44e9-a8bb-85203d84e785 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:05.738416 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c1ee2-f556-44e9-a8bb-85203d84e785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:05.756022 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-b60c1ee2-f556-44e9-a8bb-85203d84e785 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:05.757216 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-b60c1ee2-f556-44e9-a8bb-85203d84e785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:05.777755 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:05.816011 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:05.834301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d6f0a-d11e-4327-befc-9713ad690a18 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:05.838710 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 37/66] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:05.843791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e8a2-2ac4-47c4-8537-28c7c1163691 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:05.843791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e8a2-2ac4-47c4-8537-28c7c1163691 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:05.843791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687e8a2-2ac4-47c4-8537-28c7c1163691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:05.869749 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e687e8a2-2ac4-47c4-8537-28c7c1163691 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:05.872045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e687e8a2-2ac4-47c4-8537-28c7c1163691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:05.890554 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:05.891688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:05.892322 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:05.892830 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:05.904447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:05.913956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:05.914803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:05.915549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:05.918042 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 30/67] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:05.919052 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:05.949115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 38/68] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:05.950192 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e8a2-2ac4-47c4-8537-28c7c1163691 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.037196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8249d-7e60-4b7b-a7a7-ead8e8271b10 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.056457 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.076160 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687e8a2-2ac4-47c4-8537-28c7c1163691 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.079618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.080865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.081351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.081820 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.095379 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:06.104807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:06.105648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:06.106408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:06.108866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 31/69] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:06.115278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.118259 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.119162 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.119452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.119751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.120637 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:06.120955 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.121665 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.124279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.135173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 39/70] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:06.136409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.228298 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b065071-df7e-451b-ad99-08ae90392e5a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.247618 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42b12b-b3ce-4dce-945e-d5620b40a688 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.265926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.266724 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.267112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.267402 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.279863 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:06.288802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:06.289813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:06.290749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:06.292887 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91fa09-6d85-42df-85fc-de73619597b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.293157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 32/71] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:06.293588 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91fa09-6d85-42df-85fc-de73619597b8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.293877 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91fa09-6d85-42df-85fc-de73619597b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.294160 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91fa09-6d85-42df-85fc-de73619597b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.294543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.294933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91fa09-6d85-42df-85fc-de73619597b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:06.295319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91fa09-6d85-42df-85fc-de73619597b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.296733 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91fa09-6d85-42df-85fc-de73619597b8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.307134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 40/72] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:06.308858 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a645-4195-4450-95f2-c0e117db4e36 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.309150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a645-4195-4450-95f2-c0e117db4e36 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.309430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a645-4195-4450-95f2-c0e117db4e36 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.311487 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 41/73] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:06.313575 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a645-4195-4450-95f2-c0e117db4e36 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.329587 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.368994 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.410121 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7d0da-04e8-4d15-bdb5-5ca194e7f7bc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.434336 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a645-4195-4450-95f2-c0e117db4e36 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.445586 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.446466 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.446756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.447035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] PATH_INFO: `/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.448552 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] RBAC: Authorizing `identity:get_user(user_id=1a5c2341cb2b4b2f93d951457ae1d5c4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.449737 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.451364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 33/74] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:06.455243 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.468132 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b657e3-013d-46d1-9820-bdeebc2b5ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.468802 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b657e3-013d-46d1-9820-bdeebc2b5ab8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.469090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b657e3-013d-46d1-9820-bdeebc2b5ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.469372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b657e3-013d-46d1-9820-bdeebc2b5ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.470113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b657e3-013d-46d1-9820-bdeebc2b5ab8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:06.470423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b657e3-013d-46d1-9820-bdeebc2b5ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.471816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b657e3-013d-46d1-9820-bdeebc2b5ab8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.480328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 42/75] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:06.481504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33c4a-6337-41ae-b90f-fc69d9e0216d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.481795 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33c4a-6337-41ae-b90f-fc69d9e0216d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.482074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33c4a-6337-41ae-b90f-fc69d9e0216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.499202 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7bb33c4a-6337-41ae-b90f-fc69d9e0216d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:06.500466 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7bb33c4a-6337-41ae-b90f-fc69d9e0216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:06.556340 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51515ad0-238b-43d9-9db3-113f77cb77bc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.562444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.567988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 43/76] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:06.569897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928997d-c1af-4a1c-a1c3-7e4aaff353aa None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.570204 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928997d-c1af-4a1c-a1c3-7e4aaff353aa None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.570492 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928997d-c1af-4a1c-a1c3-7e4aaff353aa None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.575934 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 44/77] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:06.575934 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928997d-c1af-4a1c-a1c3-7e4aaff353aa None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.592016 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.597113 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.597996 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.598385 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.598669 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.613106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.614652 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.616412 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 34/78] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:06.620607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.685278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928997d-c1af-4a1c-a1c3-7e4aaff353aa None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.720367 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.721018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.721112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0553-6444-418e-a6f1-a2d441c4d0cd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.721359 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.721649 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.755504 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200b5f1-f7f4-4286-a651-ca88051afe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:06.756479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b5f1-f7f4-4286-a651-ca88051afe50 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.756775 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b5f1-f7f4-4286-a651-ca88051afe50 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.757056 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b5f1-f7f4-4286-a651-ca88051afe50 None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.758264 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200b5f1-f7f4-4286-a651-ca88051afe50 None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.760015 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200b5f1-f7f4-4286-a651-ca88051afe50 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.761641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 35/79] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:06.762788 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194cb42-a1bb-4a42-962e-b37da6a75774 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:06.763081 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194cb42-a1bb-4a42-962e-b37da6a75774 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:06.763369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194cb42-a1bb-4a42-962e-b37da6a75774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:06.780718 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-3194cb42-a1bb-4a42-962e-b37da6a75774 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:06.781908 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-3194cb42-a1bb-4a42-962e-b37da6a75774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:06.790451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.792756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:06.794768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:06.834971 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.850249 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 36/80] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:06.851021 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194cb42-a1bb-4a42-962e-b37da6a75774 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.895079 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 45/81] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:06.895079 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:06.965546 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194cb42-a1bb-4a42-962e-b37da6a75774 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:06.993321 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:06.996223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f46c-ef96-4cb6-889e-f9a9188b0059 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.001230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.002034 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.002329 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.002616 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.013209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:07.021381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:07.022299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:07.023068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 37/82] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:07.023674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.036859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.037528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.037819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.038101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.072091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.105892 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.107293 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.124344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35da52-e6e7-411c-8ab3-04a4bc2569bb None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.159330 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.160019 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.160315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.160606 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.204328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.208295 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 46/83] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:07.209229 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.232260 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.234269 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.281016 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.306321 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befc837-084f-481d-b141-5428c1424a59 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.331360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 38/84] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:07.332229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.345101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.346532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.346829 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.347107 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.348569 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.350028 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.351657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 47/85] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:07.356745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.421965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.430805 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47533a73-d13a-45a9-8421-643d00876c4f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.456328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564cae-ebd1-44d5-b08e-8241d702486c None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.464769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.465631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.465924 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.466207 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.467465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.468952 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.470639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 39/86] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:07.471406 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.489813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.495140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.495855 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.496146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.496426 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.497171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:07.497481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.498938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.507150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 48/87] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:07.507150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.571828 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f65ac-41d6-4d9a-9126-5fd2f8d147ca None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.604893 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.605807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.606102 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.606412 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.607785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.609186 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.609282 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ccd52-9ff9-4e81-90dc-ae6413718d77 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.610888 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 40/88] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:07.611636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.639149 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.645823 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.646697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.646988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.647265 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.648441 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.649881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.651584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 49/89] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:07.652967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.696679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.712198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8256935-8b3f-479b-8dce-1c24fc8e995b None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.746190 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.746860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.747150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.747429 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.748667 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.750138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.753946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb6ff4-88f1-45d4-9101-e1dce7887528 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.777571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 41/90] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:30:07 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:07.778409 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.790684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.792235 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.792575 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.792861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.793758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=1a5c2341cb2b4b2f93d951457ae1d5c4) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:07.794079 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.795690 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.802954 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 50/91] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/role_assignments?user.id=1a5c2341cb2b4b2f93d951457ae1d5c4&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=8442e7332b934407beff8c3564575b62 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:07.803893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:07.878302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:07.930641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5374dec-ac79-4ad4-b18b-b61ddf231e2c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.933221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b64af-bf54-4ffe-a711-9f1b109f6721 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:07.987907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.988722 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.988898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.989165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.990030 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] RBAC: Adding query filter params (role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=77ac4ae6d3af4243af797ace724b7e68) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:07.990349 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.991914 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:07.992456 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:07.993604 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:07.994445 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:07.994941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:07.997573 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:07.998768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 51/92] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/role_assignments?user.id=77ac4ae6d3af4243af797ace724b7e68&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=62b39839f9fe48649ad91d0114c66534 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:08.000093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:08.002520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 42/93] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:08.003581 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:08.013451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:08.031271 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:08.146842 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f073230-3aa9-4935-8a60-f21fc526d3f1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:08.149452 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2c222-eb52-443f-845c-d19aa0fb0568 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:08.176421 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:08.186658 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:08.187384 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:08.187674 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:08.187988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:08.188893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=77ac4ae6d3af4243af797ace724b7e68) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:08.189217 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:08.190958 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:08.197628 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 52/94] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:07 2022] GET /identity/v3/role_assignments?user.id=77ac4ae6d3af4243af797ace724b7e68&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:08.199765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:08.200439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:08.200725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:08.201003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:08.292286 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:08.293782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:08.311206 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:08.410606 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 43/95] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:08.412112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:08.521097 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12c96a-60e5-4942-b2b2-00d17261e884 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:08.556688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4919-007a-4132-a933-da3332f226c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:08.557567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4919-007a-4132-a933-da3332f226c6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:08.557856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4919-007a-4132-a933-da3332f226c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:08.558138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4919-007a-4132-a933-da3332f226c6 None admin] PATH_INFO: `/v3/projects/269266f4bc484561a85838f469a5daf9` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:08.559343 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d4919-007a-4132-a933-da3332f226c6 None admin] RBAC: Authorizing `identity:get_project(project_id=269266f4bc484561a85838f469a5daf9)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:08.561406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d4919-007a-4132-a933-da3332f226c6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:08.563275 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 53/96] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:08 2022] GET /identity/v3/projects/269266f4bc484561a85838f469a5daf9 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:08.569244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:08.673417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17798c8-2807-409d-a1f3-803ebf6c08ed None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:08.682909 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:08.708630 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a8e0e-6b21-48f5-ab29-137ffd06e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:08.709309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8e0e-6b21-48f5-ab29-137ffd06e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:08.709599 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8e0e-6b21-48f5-ab29-137ffd06e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:08.709882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a8e0e-6b21-48f5-ab29-137ffd06e8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:08.710731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a8e0e-6b21-48f5-ab29-137ffd06e8a5 None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=269266f4bc484561a85838f469a5daf9, user.id=77ac4ae6d3af4243af797ace724b7e68) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:08.711047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a8e0e-6b21-48f5-ab29-137ffd06e8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:08.712524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a8e0e-6b21-48f5-ab29-137ffd06e8a5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:08.720155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 44/97] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:08 2022] GET /identity/v3/role_assignments?user.id=77ac4ae6d3af4243af797ace724b7e68&scope.project.id=269266f4bc484561a85838f469a5daf9&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:10.755891 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e77794-17d6-4c04-82b8-747fe70655ab None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:10.756394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e77794-17d6-4c04-82b8-747fe70655ab None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:10.756464 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e77794-17d6-4c04-82b8-747fe70655ab None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:10.758129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 54/98] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:10.764193 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e805fc-7fe5-4d77-ac09-0640b7dd9e11 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:10.764583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e805fc-7fe5-4d77-ac09-0640b7dd9e11 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:10.764765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e805fc-7fe5-4d77-ac09-0640b7dd9e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:10.786821 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-87e805fc-7fe5-4d77-ac09-0640b7dd9e11 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:10.788070 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-87e805fc-7fe5-4d77-ac09-0640b7dd9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:10.865477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 45/99] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:10.889682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e77794-17d6-4c04-82b8-747fe70655ab None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:10.967781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:11.012710 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e77794-17d6-4c04-82b8-747fe70655ab None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:11.051247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a39ff7-0834-434c-ab10-4d1aa19fbd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:11.052099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39ff7-0834-434c-ab10-4d1aa19fbd65 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.052393 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39ff7-0834-434c-ab10-4d1aa19fbd65 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.052679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39ff7-0834-434c-ab10-4d1aa19fbd65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.064080 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a39ff7-0834-434c-ab10-4d1aa19fbd65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-c0a39ff7-0834-434c-ab10-4d1aa19fbd65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:11.071853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:11.072661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:11.073399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:11.073971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 55/100] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:11.084217 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e805fc-7fe5-4d77-ac09-0640b7dd9e11 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:11.113364 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddae6-2bd2-4e9c-91bf-4639287b83ca None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.113789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddae6-2bd2-4e9c-91bf-4639287b83ca None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.114286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddae6-2bd2-4e9c-91bf-4639287b83ca None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.117275 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 56/101] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:11.122481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862562d1-6d1a-44ad-8a94-634cd70cc705 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.122776 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862562d1-6d1a-44ad-8a94-634cd70cc705 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.123692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862562d1-6d1a-44ad-8a94-634cd70cc705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.156218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-862562d1-6d1a-44ad-8a94-634cd70cc705 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:11.157512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-862562d1-6d1a-44ad-8a94-634cd70cc705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:11.221227 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e805fc-7fe5-4d77-ac09-0640b7dd9e11 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:11.232134 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:11.259879 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a12137-5db3-4ebd-8478-22fd6fea8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:11.260834 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a12137-5db3-4ebd-8478-22fd6fea8d62 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.261269 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a12137-5db3-4ebd-8478-22fd6fea8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.261694 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a12137-5db3-4ebd-8478-22fd6fea8d62 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.262588 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a12137-5db3-4ebd-8478-22fd6fea8d62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:11.263107 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a12137-5db3-4ebd-8478-22fd6fea8d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:11.265394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a12137-5db3-4ebd-8478-22fd6fea8d62 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:11.274796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 46/102] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:11.276374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7010a1-19fb-43bb-8b0a-034e193ee62e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.277072 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7010a1-19fb-43bb-8b0a-034e193ee62e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.277526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7010a1-19fb-43bb-8b0a-034e193ee62e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.278916 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 47/103] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:11.283980 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7010a1-19fb-43bb-8b0a-034e193ee62e None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:11.347294 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 57/104] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:11.349077 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aec70-3be7-4729-a3aa-8f337560c3b1 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.351138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aec70-3be7-4729-a3aa-8f337560c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.351572 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aec70-3be7-4729-a3aa-8f337560c3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.383840 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f97aec70-3be7-4729-a3aa-8f337560c3b1 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:11.385521 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f97aec70-3be7-4729-a3aa-8f337560c3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:11.423840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7010a1-19fb-43bb-8b0a-034e193ee62e None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:11.463643 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:11.465078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.466279 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.467489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] PATH_INFO: `/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.471332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5c2341cb2b4b2f93d951457ae1d5c4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:11.473792 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:11.478201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 48/105] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:11 2022] GET /identity/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:11.481405 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:11.501808 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:11.541291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:11.549225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 58/106] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:11.550112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aec70-3be7-4729-a3aa-8f337560c3b1 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:11.654141 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3f19a-33e5-4f6a-9c4e-f6b7af294630 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:11.691082 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:11.692305 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.692800 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.693315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.704761 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:11.713188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:11.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:11.714818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:11.715996 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aec70-3be7-4729-a3aa-8f337560c3b1 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:11.718045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 49/107] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:11.719037 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:11.760093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138e5df-a5ee-4869-a4cd-90b3dd9fb4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:11.760977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138e5df-a5ee-4869-a4cd-90b3dd9fb4a7 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.761703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138e5df-a5ee-4869-a4cd-90b3dd9fb4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.761703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138e5df-a5ee-4869-a4cd-90b3dd9fb4a7 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.762866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138e5df-a5ee-4869-a4cd-90b3dd9fb4a7 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:11.765090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138e5df-a5ee-4869-a4cd-90b3dd9fb4a7 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:11.767309 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 59/108] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:11 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:11.768544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b4ca-c5f2-45b9-9a41-0eeccc7cb94f None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.768841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b4ca-c5f2-45b9-9a41-0eeccc7cb94f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.769128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b4ca-c5f2-45b9-9a41-0eeccc7cb94f None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.775919 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 60/109] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:11.780858 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b4ca-c5f2-45b9-9a41-0eeccc7cb94f None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:11.848450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:11.852391 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:11.863474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a4cd-e97b-4765-a284-928cfa4db456 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:11.901881 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:11.903004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.903476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.903960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.915377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:11.923479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:11.924391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:11.925167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:11.927447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 50/110] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:11.928299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b4ca-c5f2-45b9-9a41-0eeccc7cb94f None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:11.928690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:11.970786 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ff11-ff61-4ffc-8a71-21d2f25a5989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:11.971521 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ff11-ff61-4ffc-8a71-21d2f25a5989 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.971853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ff11-ff61-4ffc-8a71-21d2f25a5989 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.972139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ff11-ff61-4ffc-8a71-21d2f25a5989 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:11.972958 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ff11-ff61-4ffc-8a71-21d2f25a5989 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:11.973534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ff11-ff61-4ffc-8a71-21d2f25a5989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:11.975380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ff11-ff61-4ffc-8a71-21d2f25a5989 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:11.985071 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 61/111] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:11.991237 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba6ac-f23f-4e41-b594-4da954056694 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:11.991539 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba6ac-f23f-4e41-b594-4da954056694 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:11.991920 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba6ac-f23f-4e41-b594-4da954056694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.009540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-101ba6ac-f23f-4e41-b594-4da954056694 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:12.010799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-101ba6ac-f23f-4e41-b594-4da954056694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:12.041218 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2a9a-3816-4665-913a-8e77dbb719eb None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.078189 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a4404-6ac2-48d7-bd81-fb9a1cba49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.079086 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a4404-6ac2-48d7-bd81-fb9a1cba49f4 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.079377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a4404-6ac2-48d7-bd81-fb9a1cba49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.079659 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a4404-6ac2-48d7-bd81-fb9a1cba49f4 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/1a5c2341cb2b4b2f93d951457ae1d5c4/roles/8442e7332b934407beff8c3564575b62` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.081973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a4404-6ac2-48d7-bd81-fb9a1cba49f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=07eb2ce2492b445686e24aed81fe97c8, user_id=1a5c2341cb2b4b2f93d951457ae1d5c4, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.083444 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a4404-6ac2-48d7-bd81-fb9a1cba49f4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.095909 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 62/112] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:12.095909 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba6ac-f23f-4e41-b594-4da954056694 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.110930 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 51/113] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:11 2022] PUT /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/1a5c2341cb2b4b2f93d951457ae1d5c4/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:12.118117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9e5e-f9de-4450-81a5-f5787d0ffbd9 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.118732 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9e5e-f9de-4450-81a5-f5787d0ffbd9 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.119362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9e5e-f9de-4450-81a5-f5787d0ffbd9 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.121700 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 52/114] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:12.123391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9e5e-f9de-4450-81a5-f5787d0ffbd9 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.150823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:12.154096 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:12.236464 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba6ac-f23f-4e41-b594-4da954056694 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.280857 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.281836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.282324 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.282756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.283818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:12.284335 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.286016 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.290703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9e5e-f9de-4450-81a5-f5787d0ffbd9 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.296938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 63/115] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:12.298098 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.333198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210ab1c-8f3b-4ed9-8cdf-0334a1221aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.334025 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ab1c-8f3b-4ed9-8cdf-0334a1221aef None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.334316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ab1c-8f3b-4ed9-8cdf-0334a1221aef None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.334601 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ab1c-8f3b-4ed9-8cdf-0334a1221aef None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.335849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ab1c-8f3b-4ed9-8cdf-0334a1221aef None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.337335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ab1c-8f3b-4ed9-8cdf-0334a1221aef None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.338985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 53/116] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:12.340309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5544e-2d77-4eb2-8bb9-16d332fcb1d6 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.340612 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5544e-2d77-4eb2-8bb9-16d332fcb1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.340890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5544e-2d77-4eb2-8bb9-16d332fcb1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.358052 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-41f5544e-2d77-4eb2-8bb9-16d332fcb1d6 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:12.359268 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-41f5544e-2d77-4eb2-8bb9-16d332fcb1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:12.420541 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:12.423911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad53838-e9fe-42fb-ac5a-a3ac30c11563 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.445564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 54/117] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:12.446428 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5544e-2d77-4eb2-8bb9-16d332fcb1d6 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.464105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:12.466084 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.466929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.467213 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.467495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.468742 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.470192 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.471953 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 64/118] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:12.472718 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.562138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5544e-2d77-4eb2-8bb9-16d332fcb1d6 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.576886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02111463-87e1-4be3-b247-a58c17381a50 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.597613 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a233cc-2e38-4310-9725-4f6e94f6a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.598500 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a233cc-2e38-4310-9725-4f6e94f6a114 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.598792 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a233cc-2e38-4310-9725-4f6e94f6a114 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.599078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a233cc-2e38-4310-9725-4f6e94f6a114 None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.600324 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a233cc-2e38-4310-9725-4f6e94f6a114 None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.601794 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a233cc-2e38-4310-9725-4f6e94f6a114 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.603431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 55/119] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:12.604649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31db9b8-eee0-4fa3-9c1b-5d83401328f0 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.605019 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31db9b8-eee0-4fa3-9c1b-5d83401328f0 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.605307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31db9b8-eee0-4fa3-9c1b-5d83401328f0 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.606783 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 56/120] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:12.608052 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31db9b8-eee0-4fa3-9c1b-5d83401328f0 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.626331 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.628302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.628746 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.629501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.632020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.633660 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.641164 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 65/121] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:12.641164 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.685289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:12.698730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:12.724956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31db9b8-eee0-4fa3-9c1b-5d83401328f0 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.757762 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a3cd5-55bc-4abe-9cad-e1527df82d62 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.760768 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.761575 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.761870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.762160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.773344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:12.781679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:12.782532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:12.783356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 57/122] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:12.784555 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.805455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd76d4-ed67-4159-a2c6-3ee7f662e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.806138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd76d4-ed67-4159-a2c6-3ee7f662e1a3 None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.806433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd76d4-ed67-4159-a2c6-3ee7f662e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.806717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd76d4-ed67-4159-a2c6-3ee7f662e1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.807461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd76d4-ed67-4159-a2c6-3ee7f662e1a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.808967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd76d4-ed67-4159-a2c6-3ee7f662e1a3 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.847444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 66/123] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:30:12 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:12.848728 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c6fc-cfc6-4b64-b1a8-511dade6d405 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.849030 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c6fc-cfc6-4b64-b1a8-511dade6d405 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.849550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c6fc-cfc6-4b64-b1a8-511dade6d405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.871161 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f1b2c6fc-cfc6-4b64-b1a8-511dade6d405 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:12.872482 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f1b2c6fc-cfc6-4b64-b1a8-511dade6d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:12.927384 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa22fb8-796d-4de6-93d3-cd197e44aadd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:12.968790 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 67/124] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:12.969745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c6fc-cfc6-4b64-b1a8-511dade6d405 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.977170 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:12.978270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:12.979068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:12.979542 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:12.981565 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:12.985954 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:12.988139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 58/125] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:12.989167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:12.994809 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:12.999725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:13.098043 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c6fc-cfc6-4b64-b1a8-511dade6d405 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:13.128216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d214e-60c9-4799-abb4-6d71d28788ec None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:13.140592 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:13.141500 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:13.141791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:13.142073 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/77ac4ae6d3af4243af797ace724b7e68/roles/62b39839f9fe48649ad91d0114c66534` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:13.144382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] RBAC: Authorizing `identity:create_grant(project_id=07eb2ce2492b445686e24aed81fe97c8, user_id=77ac4ae6d3af4243af797ace724b7e68, role_id=62b39839f9fe48649ad91d0114c66534)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:13.146635 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:13.163637 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 68/126] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:12 2022] PUT /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/77ac4ae6d3af4243af797ace724b7e68/roles/62b39839f9fe48649ad91d0114c66534 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:13.164372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:13.184076 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:13.184777 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:13.185075 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:13.185469 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:13.186259 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:13.186578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:13.189004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:13.204202 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 59/127] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:13.209055 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:13.288763 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:13.312303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da773b66-6bd7-402d-8bf7-65911095f114 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:13.350171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:13.351097 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:13.351391 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:13.351677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/77ac4ae6d3af4243af797ace724b7e68/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:13.353841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=07eb2ce2492b445686e24aed81fe97c8, user_id=77ac4ae6d3af4243af797ace724b7e68, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:13.355310 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:13.379904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 69/128] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:13 2022] PUT /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/77ac4ae6d3af4243af797ace724b7e68/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:13.381459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:13.381640 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:13.438750 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2961-e3b7-44a9-a5a5-414c52f77502 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:13.483869 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:13.484908 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:13.485222 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:13.485508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:13.508488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:13.523008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:13.523976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:13.524726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:13.527259 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 60/129] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:13.536624 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:13.580199 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a8444-4f15-437f-8670-b19664f197a6 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:13.623778 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:13.625221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:13.625658 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:13.626078 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] PATH_INFO: `/v3/users/b7ded1e020604c608db2d51d19e6ab7b` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:13.635826 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:13.648841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] RBAC: Authorizing `identity:get_user(user_id=b7ded1e020604c608db2d51d19e6ab7b)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:13.651605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:13.654114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 70/130] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:13 2022] GET /identity/v3/users/b7ded1e020604c608db2d51d19e6ab7b => generated 289 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:13.661228 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:13.731475 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d454582-b96f-4455-8bd2-2a3565da61f5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:13.799637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:13.821346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:13.822290 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:13.822735 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:13.823157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:13.825282 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:13.825771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:13.827403 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:13.847216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 61/131] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:13.858334 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:13.910939 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae1881-b88c-4c2e-83a8-582ad7833b0a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:14.024830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:14.025174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:14.025467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:14.025754 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:14.050118 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1cc7-ee65-4901-a885-155a9769ca69 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:14.105904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:14.110704 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:14.112047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:14.112492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:14.114265 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:14.120851 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:14.125204 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 62/132] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:13 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:14.133302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:14.217221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:14.244912 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:14.251779 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:14.277284 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:14.374802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f286626-8740-4800-994b-1d88b0f26180 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:14.463213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:14.466811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:14.466811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:14.466811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] PATH_INFO: `/v3/projects/269266f4bc484561a85838f469a5daf9` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:14.466811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] RBAC: Authorizing `identity:get_project(project_id=269266f4bc484561a85838f469a5daf9)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:14.467704 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:14.475765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 63/133] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:14 2022] GET /identity/v3/projects/269266f4bc484561a85838f469a5daf9 => generated 312 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:14.481484 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:14.617006 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 71/134] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 956 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:30:14.630381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:14.767518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638034da-2926-4c55-b85d-92bf4bcffc7d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:14.828115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:14.837224 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97652-3861-49a9-b45e-3aefd3158a18 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:14.847651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:14.894536 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c484d-fd9a-4485-b2d0-1f36b222a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:14.896004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c484d-fd9a-4485-b2d0-1f36b222a9bb None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:14.896495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c484d-fd9a-4485-b2d0-1f36b222a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:14.896983 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c484d-fd9a-4485-b2d0-1f36b222a9bb None admin] PATH_INFO: `/v3/projects/269266f4bc484561a85838f469a5daf9/users/77ac4ae6d3af4243af797ace724b7e68/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:14.900820 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c484d-fd9a-4485-b2d0-1f36b222a9bb None admin] RBAC: Authorizing `identity:create_grant(project_id=269266f4bc484561a85838f469a5daf9, user_id=77ac4ae6d3af4243af797ace724b7e68, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:14.903441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c484d-fd9a-4485-b2d0-1f36b222a9bb None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:14.913506 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:14.917410 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:14.918296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:14.918716 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:14.920597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:14.922133 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:14.927685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 72/135] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:14 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:14.933818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:14.935386 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 64/136] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:14 2022] PUT /identity/v3/projects/269266f4bc484561a85838f469a5daf9/users/77ac4ae6d3af4243af797ace724b7e68/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:15.160074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f992f1-3ffc-43f6-a8ee-be6d7b67577d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:15.224738 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c5617-6fbb-4c08-b920-99aafef83711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:15.225872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c5617-6fbb-4c08-b920-99aafef83711 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:15.226370 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c5617-6fbb-4c08-b920-99aafef83711 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:15.226854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c5617-6fbb-4c08-b920-99aafef83711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:15.228142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c5617-6fbb-4c08-b920-99aafef83711 None admin] RBAC: Adding query filter params (role.id=61243bfc1a6942c98b2e8f3d6fb716c0, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=b7ded1e020604c608db2d51d19e6ab7b) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:15.228698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c5617-6fbb-4c08-b920-99aafef83711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:15.230430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c5617-6fbb-4c08-b920-99aafef83711 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:15.237709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 73/137] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:14 2022] GET /identity/v3/role_assignments?user.id=b7ded1e020604c608db2d51d19e6ab7b&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=61243bfc1a6942c98b2e8f3d6fb716c0 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:15.255901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee281d-8f57-4c78-b49b-b18f1bd413f8 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:15.256421 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee281d-8f57-4c78-b49b-b18f1bd413f8 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:15.256516 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee281d-8f57-4c78-b49b-b18f1bd413f8 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:15.258128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 65/138] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:15.264306 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72775cb-1068-4a53-8f0a-280ee9b9f9b3 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:15.264943 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72775cb-1068-4a53-8f0a-280ee9b9f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:15.265431 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72775cb-1068-4a53-8f0a-280ee9b9f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:15.300070 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-c72775cb-1068-4a53-8f0a-280ee9b9f9b3 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:15.301678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-c72775cb-1068-4a53-8f0a-280ee9b9f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:15.334888 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:15.387943 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 74/139] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:15.429431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee281d-8f57-4c78-b49b-b18f1bd413f8 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:15.574155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee281d-8f57-4c78-b49b-b18f1bd413f8 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:15.628462 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:15.629289 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:15.629585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:15.629872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:15.646946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:15.656988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:15.657842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:15.659009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:15.660116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 66/140] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:15.664856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72775cb-1068-4a53-8f0a-280ee9b9f9b3 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:15.841174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72775cb-1068-4a53-8f0a-280ee9b9f9b3 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:15.887799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:15.889065 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:15.889354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:15.889635 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:15.890388 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:15.890696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:15.892171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:15.900902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 75/141] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:15.908823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:15.971076 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.061506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46adaca-020b-4c1b-984b-5fd55060c751 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:16.106430 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:16.107840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:16.108135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:16.108417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] PATH_INFO: `/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:16.109637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=1a5c2341cb2b4b2f93d951457ae1d5c4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:16.111091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:16.112731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 67/142] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:15 2022] GET /identity/v3/users/1a5c2341cb2b4b2f93d951457ae1d5c4 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:16.118781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:16.145834 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.236663 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776657c-a34f-450e-b087-ae421bf0bca5 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:16.280713 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:16.281741 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:16.282228 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:16.282733 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:16.383201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:16.385443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:16.410411 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.502595 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 76/143] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:16.508330 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:16.677310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132aa25-4a4f-4381-a432-ee5f2e78e1a3 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:16.697727 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.720682 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b01598-de0a-4b7e-acb5-d596b1c72546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:16.721563 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01598-de0a-4b7e-acb5-d596b1c72546 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:16.721896 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01598-de0a-4b7e-acb5-d596b1c72546 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:16.722186 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b01598-de0a-4b7e-acb5-d596b1c72546 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:16.723386 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01598-de0a-4b7e-acb5-d596b1c72546 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:16.724876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b01598-de0a-4b7e-acb5-d596b1c72546 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:16.726581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 68/144] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:16 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:16.733416 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:16.740678 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861591c-9041-4eeb-9100-f90f21728c7a None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:16.740983 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861591c-9041-4eeb-9100-f90f21728c7a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:16.741263 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861591c-9041-4eeb-9100-f90f21728c7a None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:16.742803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 69/145] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:16.748741 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f503a-dd30-40ed-a891-30c7fa0fca52 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:16.749055 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f503a-dd30-40ed-a891-30c7fa0fca52 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:16.749308 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f503a-dd30-40ed-a891-30c7fa0fca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:16.779926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-603f503a-dd30-40ed-a891-30c7fa0fca52 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:16.781211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-603f503a-dd30-40ed-a891-30c7fa0fca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:16.937082 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f482306-0834-47be-8779-3d0326c24ddc None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:16.943473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 70/146] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:16.982998 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:16.985122 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f503a-dd30-40ed-a891-30c7fa0fca52 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:16.993992 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775065ee-e5b1-4f5f-b3c7-172c30751487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:16.994664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775065ee-e5b1-4f5f-b3c7-172c30751487 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:16.994950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775065ee-e5b1-4f5f-b3c7-172c30751487 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:16.995232 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775065ee-e5b1-4f5f-b3c7-172c30751487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:16.996105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775065ee-e5b1-4f5f-b3c7-172c30751487 None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=1a5c2341cb2b4b2f93d951457ae1d5c4) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:16.996423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775065ee-e5b1-4f5f-b3c7-172c30751487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:16.997963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775065ee-e5b1-4f5f-b3c7-172c30751487 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:17.008211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 77/147] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:16 2022] GET /identity/v3/role_assignments?user.id=1a5c2341cb2b4b2f93d951457ae1d5c4&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=8442e7332b934407beff8c3564575b62 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:17.043581 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af9f16-ed14-47e1-82a5-ec9e3d1064c1 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.043901 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af9f16-ed14-47e1-82a5-ec9e3d1064c1 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.044188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af9f16-ed14-47e1-82a5-ec9e3d1064c1 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.047295 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 78/148] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:17.052892 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8b65c-2409-4642-9abe-7e7ff5ef794e None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.053181 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8b65c-2409-4642-9abe-7e7ff5ef794e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.053469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8b65c-2409-4642-9abe-7e7ff5ef794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.088929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-19b8b65c-2409-4642-9abe-7e7ff5ef794e None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:17.090138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-19b8b65c-2409-4642-9abe-7e7ff5ef794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:17.133187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f503a-dd30-40ed-a891-30c7fa0fca52 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:17.148883 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:17.181694 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab989bd-f27c-4976-b3d4-0c4118988e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:17.183901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab989bd-f27c-4976-b3d4-0c4118988e66 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.184207 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab989bd-f27c-4976-b3d4-0c4118988e66 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.184490 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab989bd-f27c-4976-b3d4-0c4118988e66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.188135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab989bd-f27c-4976-b3d4-0c4118988e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:17.189562 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab989bd-f27c-4976-b3d4-0c4118988e66 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:17.193526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 71/149] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:17.201326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8faf-05be-482f-af26-a4c67598ecd4 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.201688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8faf-05be-482f-af26-a4c67598ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.201974 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f8faf-05be-482f-af26-a4c67598ecd4 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.203697 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 72/150] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:17.210962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f8faf-05be-482f-af26-a4c67598ecd4 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:17.244981 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 79/151] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:17.251765 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f88f5-3f42-4570-a0db-589294062be5 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.253147 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f88f5-3f42-4570-a0db-589294062be5 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.253664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f88f5-3f42-4570-a0db-589294062be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.277797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-084f88f5-3f42-4570-a0db-589294062be5 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:17.279979 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-084f88f5-3f42-4570-a0db-589294062be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:17.368505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 80/152] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:17.369377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f88f5-3f42-4570-a0db-589294062be5 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:17.406132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f8faf-05be-482f-af26-a4c67598ecd4 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:17.426030 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:17.455261 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:17.456129 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.456423 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.456706 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.457434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:17.458879 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:17.483802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 73/153] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:30:17 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:17.485145 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:17.497049 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f88f5-3f42-4570-a0db-589294062be5 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:17.536073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:17.543585 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:17.544600 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.544975 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.545435 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.562235 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:17.574641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:17.575507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:17.576851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:17.577441 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 81/154] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:17.583508 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:17.665938 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f477905-bec1-470e-9b06-482b27d0327e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:17.737378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:17.738543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.739032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.739508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.746642 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3f4c1-3c47-4f6c-a4a8-df8e3a9a6f11 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:17.751109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:17.755776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:17.764584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:17.765434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:17.766358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:17.769440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 74/155] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:17.776872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:17.805579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:17.806280 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.806566 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.806843 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.807605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:17.807937 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:17.809432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:17.826649 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 82/156] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:17.835464 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:17.902924 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:17.911941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79517d00-1b36-416f-a455-1f0f84c792dd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:17.992222 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:17.992959 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:17.993775 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:17.993775 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:17.994544 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:17.994956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:17.996795 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.007565 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 75/157] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:18.008544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6dd44-5051-4506-a6d0-0bd09188a3ad None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.015677 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:18.062704 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.064206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.064654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.065081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.066579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.068284 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.070476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 83/158] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:17 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:18.076097 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:18.116915 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:18.148457 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9d5bb-f539-4c32-94e9-972c9cf28713 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.187673 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.188836 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.189221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.189598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.190938 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.192540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.194427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 76/159] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:18 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:18.198026 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f653adb-3453-4f27-982e-85c9adca852e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.200144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:18.234639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:18.242006 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.243001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.243437 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.243977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.323962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e2d3-ebe0-4313-9b8a-8d94db524f1f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.329854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.332222 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.362152 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.363067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.363581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.364080 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.371107 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:18.441801 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.443723 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.448174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 84/160] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:30:18.455154 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:18.474873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:18.558078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 77/161] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:18.565056 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:18.568668 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c62dc-6a72-4fce-9aca-12ff0201c8e1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.605762 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.607622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.608141 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.608734 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.610230 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.611967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.614049 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 85/162] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:18 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:18.620295 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:18.625031 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:18.677150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2e03-e19d-4f77-95eb-374c9959c0dd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.705346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:18.715286 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.716442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.716891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.717362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.718760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.720436 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.722329 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 78/163] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:18 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:18.730736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:18.739451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508344a-2e5e-478c-bab3-14e6ffe9cb51 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.799085 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cb8d5-87ff-47ac-84ae-460a911d2113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.800119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb8d5-87ff-47ac-84ae-460a911d2113 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.800646 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb8d5-87ff-47ac-84ae-460a911d2113 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.801104 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb8d5-87ff-47ac-84ae-460a911d2113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.802230 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb8d5-87ff-47ac-84ae-460a911d2113 None admin] RBAC: Adding query filter params (role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=77ac4ae6d3af4243af797ace724b7e68) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:18.802964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb8d5-87ff-47ac-84ae-460a911d2113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.805991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb8d5-87ff-47ac-84ae-460a911d2113 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.815468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 86/164] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:18 2022] GET /identity/v3/role_assignments?user.id=77ac4ae6d3af4243af797ace724b7e68&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=62b39839f9fe48649ad91d0114c66534 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:18.844996 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdda01-b761-40bb-8cdc-53c61e36bbb0 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.845662 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdda01-b761-40bb-8cdc-53c61e36bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.846151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdda01-b761-40bb-8cdc-53c61e36bbb0 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.848270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 87/165] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:18.858963 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff1888-9c9f-4c80-9332-d1409db400c4 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:18.859450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1179b-ca82-4186-8fb2-b24907ba2a8e None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.860040 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1179b-ca82-4186-8fb2-b24907ba2a8e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.860525 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1179b-ca82-4186-8fb2-b24907ba2a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.901153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-afe1179b-ca82-4186-8fb2-b24907ba2a8e None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:18.902721 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-afe1179b-ca82-4186-8fb2-b24907ba2a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:18.911785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:18.911785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:18.911785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:18.911785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:18.912191 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=77ac4ae6d3af4243af797ace724b7e68) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:18.912191 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:18.912191 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:18.916660 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 79/166] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:18 2022] GET /identity/v3/role_assignments?user.id=77ac4ae6d3af4243af797ace724b7e68&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:19.033606 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:19.043509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 88/167] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:19.089137 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:19.094217 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538bc48-97f3-478c-858f-18471e904ba7 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:19.094810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538bc48-97f3-478c-858f-18471e904ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:19.095312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538bc48-97f3-478c-858f-18471e904ba7 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:19.097436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 89/168] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:19.102981 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa053d8-1557-48a1-a3f3-f5e3711cea08 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:19.103681 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa053d8-1557-48a1-a3f3-f5e3711cea08 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:19.104214 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa053d8-1557-48a1-a3f3-f5e3711cea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:19.132809 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7aa053d8-1557-48a1-a3f3-f5e3711cea08 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:19.134622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7aa053d8-1557-48a1-a3f3-f5e3711cea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:19.192125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:19.262462 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5e9ae-10f5-4c45-9d27-26beee12fd2a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:19.313525 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 90/169] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:19.328658 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:19.329778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:19.330066 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:19.330344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:19.347548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:19.355905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:19.356840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:19.357628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 80/170] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:19.360186 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa053d8-1557-48a1-a3f3-f5e3711cea08 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:19.363450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:19.521635 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe85a85-6426-49f3-b159-710a64e8aff3 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:19.538286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa053d8-1557-48a1-a3f3-f5e3711cea08 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:19.562787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:19.582388 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:19.583405 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:19.583940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:19.584426 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:19.585493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:19.586203 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:19.587846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:19.599793 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 81/171] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:19.600063 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:19.606917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:19.623150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:19.627777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:19.627777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:19.627777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:19.660498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:19.670613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:19.671504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:19.672304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 91/172] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:19.681375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:19.803772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2aa52-a2e5-4fb6-bc48-b8752969922a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:19.848341 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:19.852434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:19.852434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:19.852434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] PATH_INFO: `/v3/users/b7ded1e020604c608db2d51d19e6ab7b` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:19.864798 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b7ded1e020604c608db2d51d19e6ab7b)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:19.866361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:19.868516 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 82/173] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:19 2022] GET /identity/v3/users/b7ded1e020604c608db2d51d19e6ab7b => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:19.876791 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:19.940354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aefce4-7243-459c-a5f6-f32beb5fe78d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:20.039674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:20.042751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:20.049431 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:20.049966 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:20.050406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:20.051349 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:20.051846 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:20.053444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:20.077452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 92/174] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:20.089120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:20.166444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:20.211509 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf7ffd-e55f-46c3-86e5-75e3b707f4e5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:20.241484 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc165d8-6074-4b63-82c9-4617b9c100aa None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:20.293863 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:20.295916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:20.296433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:20.296910 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] PATH_INFO: `/v3/users/77ac4ae6d3af4243af797ace724b7e68` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:20.298528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] RBAC: Authorizing `identity:get_user(user_id=77ac4ae6d3af4243af797ace724b7e68)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:20.300458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:20.302492 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 93/175] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:20 2022] GET /identity/v3/users/77ac4ae6d3af4243af797ace724b7e68 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:20.309485 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:20.326275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:20.327258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:20.327533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:20.331022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:20.332316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:20.333795 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:20.338291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 83/176] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:19 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:20.345299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:20.470720 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a17ae2-6d10-4c45-8598-725ea905557d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:20.498313 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:20.545141 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:20.547352 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:20.548347 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:20.548862 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:20.558007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f93006-3c70-4698-873d-a1404111cdce None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:20.579810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:20.602671 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:20.603935 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:20.604473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:20.604950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/b7ded1e020604c608db2d51d19e6ab7b/roles/61243bfc1a6942c98b2e8f3d6fb716c0` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:20.608339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=07eb2ce2492b445686e24aed81fe97c8, user_id=b7ded1e020604c608db2d51d19e6ab7b, role_id=61243bfc1a6942c98b2e8f3d6fb716c0)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:20.610685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:20.644050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 84/177] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:20 2022] PUT /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8/users/b7ded1e020604c608db2d51d19e6ab7b/roles/61243bfc1a6942c98b2e8f3d6fb716c0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:20.694544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:20.696408 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:20.826140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 94/178] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:20.832043 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:20.987538 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58bce3-f920-44f6-ba58-6291042b57f5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:21.031027 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283fcf-7c0b-4648-97e9-de2b988f8de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:21.031928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283fcf-7c0b-4648-97e9-de2b988f8de1 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.032219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283fcf-7c0b-4648-97e9-de2b988f8de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.032502 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283fcf-7c0b-4648-97e9-de2b988f8de1 None admin] PATH_INFO: `/v3/projects/269266f4bc484561a85838f469a5daf9` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.033829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3283fcf-7c0b-4648-97e9-de2b988f8de1 None admin] RBAC: Authorizing `identity:get_project(project_id=269266f4bc484561a85838f469a5daf9)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:21.035292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3283fcf-7c0b-4648-97e9-de2b988f8de1 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:21.037058 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 85/179] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:20 2022] GET /identity/v3/projects/269266f4bc484561a85838f469a5daf9 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:21.048955 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:21.080348 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:21.227761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376628a6-8783-4aa5-8ca2-73b707dda721 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:21.277135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb659-591d-4179-8476-dabce16f5e8b None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.277447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb659-591d-4179-8476-dabce16f5e8b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.277914 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bb659-591d-4179-8476-dabce16f5e8b None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.279651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 86/180] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:21.286173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb07d2-9a7b-400f-8194-368e37be5ac9 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.286473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb07d2-9a7b-400f-8194-368e37be5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.286759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb07d2-9a7b-400f-8194-368e37be5ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.288239 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:21.288948 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.289187 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.289461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.290297 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=269266f4bc484561a85838f469a5daf9, user.id=77ac4ae6d3af4243af797ace724b7e68) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:21.290610 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:21.292075 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:21.302304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 95/181] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:21 2022] GET /identity/v3/role_assignments?user.id=77ac4ae6d3af4243af797ace724b7e68&scope.project.id=269266f4bc484561a85838f469a5daf9&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:21.321014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-1feb07d2-9a7b-400f-8194-368e37be5ac9 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:21.322274 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-1feb07d2-9a7b-400f-8194-368e37be5ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:21.403317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:21.454608 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 87/182] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:21.507344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:21.607310 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:21.629760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348940d7-3750-4651-aad8-a94cefe3f7d8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:21.664959 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:21.665684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.665963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.666239 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.679764 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:21.688253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:21.689139 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:21.690344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 96/183] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:21.695814 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb07d2-9a7b-400f-8194-368e37be5ac9 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:21.827027 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb07d2-9a7b-400f-8194-368e37be5ac9 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:21.865517 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b3846-9395-439a-b916-ab39a2ff52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:21.866831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3846-9395-439a-b916-ab39a2ff52f8 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.867321 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3846-9395-439a-b916-ab39a2ff52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.867863 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b3846-9395-439a-b916-ab39a2ff52f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.868815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b3846-9395-439a-b916-ab39a2ff52f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:21.869319 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b3846-9395-439a-b916-ab39a2ff52f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:21.871035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b3846-9395-439a-b916-ab39a2ff52f8 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:21.880016 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 88/184] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:21.885922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:21.971131 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee77bc-0a4d-4d38-a6d4-64ecf1622e79 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.971726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee77bc-0a4d-4d38-a6d4-64ecf1622e79 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.972249 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee77bc-0a4d-4d38-a6d4-64ecf1622e79 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.973881 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 89/185] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:21.980307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a33f-28ec-4c24-bbce-7ceb8a26a319 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:21.980803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a33f-28ec-4c24-bbce-7ceb8a26a319 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:21.981277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8a33f-28ec-4c24-bbce-7ceb8a26a319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:21.999508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-c8e8a33f-28ec-4c24-bbce-7ceb8a26a319 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:22.001149 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-c8e8a33f-28ec-4c24-bbce-7ceb8a26a319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:22.022701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb307f4e-de1b-4382-9e56-2dbf277cbc6f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.052117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.073448 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.074769 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.074769 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.075073 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] PATH_INFO: `/v3/users/a9c86a84044549a1b0355bf7215238e1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.080133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 90/186] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:22.090095 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.096704 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] RBAC: Authorizing `identity:get_user(user_id=a9c86a84044549a1b0355bf7215238e1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:22.098285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:22.101142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 97/187] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:21 2022] GET /identity/v3/users/a9c86a84044549a1b0355bf7215238e1 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:22.107870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.109227 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a33f-28ec-4c24-bbce-7ceb8a26a319 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.223561 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8a33f-28ec-4c24-bbce-7ceb8a26a319 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.238677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc3894-fc95-4849-b096-5b5bb520afcb None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.265450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff481e-88e3-4364-ae5a-0e2c070b48cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.266623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff481e-88e3-4364-ae5a-0e2c070b48cd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.267194 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff481e-88e3-4364-ae5a-0e2c070b48cd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.267809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff481e-88e3-4364-ae5a-0e2c070b48cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.277933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.278648 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.279128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.279521 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.279715 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff481e-88e3-4364-ae5a-0e2c070b48cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-2bff481e-88e3-4364-ae5a-0e2c070b48cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:22.288645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:22.289578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:22.290364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 91/188] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:22.291306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf518-64dd-4ff8-8b25-9242b78bfcdb None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.292359 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf518-64dd-4ff8-8b25-9242b78bfcdb None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.292767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf518-64dd-4ff8-8b25-9242b78bfcdb None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.294788 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 92/189] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:22.299543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf518-64dd-4ff8-8b25-9242b78bfcdb None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.331034 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.354396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.359454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:22.360983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:22.415683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf518-64dd-4ff8-8b25-9242b78bfcdb None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.461311 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0504f2-fa4a-4471-81d2-38f7609ddb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.461990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0504f2-fa4a-4471-81d2-38f7609ddb99 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.462279 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0504f2-fa4a-4471-81d2-38f7609ddb99 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.462560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0504f2-fa4a-4471-81d2-38f7609ddb99 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.463316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0504f2-fa4a-4471-81d2-38f7609ddb99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:22.463629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0504f2-fa4a-4471-81d2-38f7609ddb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:22.465041 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0504f2-fa4a-4471-81d2-38f7609ddb99 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:22.475789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 93/190] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:22.482476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13781-c938-4e7f-9f23-fd98e665b01b None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.482476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13781-c938-4e7f-9f23-fd98e665b01b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.482476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13781-c938-4e7f-9f23-fd98e665b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.482948 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 98/191] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:22.484036 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.503785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-c3b13781-c938-4e7f-9f23-fd98e665b01b None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:22.503785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-c3b13781-c938-4e7f-9f23-fd98e665b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:22.575302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 94/192] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:22.580847 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13781-c938-4e7f-9f23-fd98e665b01b None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.597555 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.603247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ae67d-547c-460e-971d-5a9dc03c1f45 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.608538 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.644276 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.645162 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.645450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.645731 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] PATH_INFO: `/v3/users/a9c86a84044549a1b0355bf7215238e1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.646951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] RBAC: Authorizing `identity:get_user(user_id=a9c86a84044549a1b0355bf7215238e1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:22.648458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:22.650100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 99/193] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/users/a9c86a84044549a1b0355bf7215238e1 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:22.650871 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.710704 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13781-c938-4e7f-9f23-fd98e665b01b None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.750792 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.751661 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.751985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.752272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.753451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:22.754901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:22.756636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 95/194] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:22.757404 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.766300 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8d232-e241-478b-93c7-1bc992e90e5d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.813319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.813319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.813319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.813657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.814600 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:22.816077 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:22.817940 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 100/195] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:22.818571 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:22.856190 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.870291 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:22.874891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdb3f1-2e28-48b7-98e6-246f14c14417 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.922960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.923997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.924286 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.924562 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.943759 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c80f9-5d06-45ad-8ffb-410caaedf9fa None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:22.990216 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:22.990901 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:22.991194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:22.991477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:22.992573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=a9c86a84044549a1b0355bf7215238e1) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:22.993009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:22.995348 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:23.011987 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 101/196] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/role_assignments?user.id=a9c86a84044549a1b0355bf7215238e1&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=8442e7332b934407beff8c3564575b62 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:23.011987 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:23.012441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:23.014907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:23.155777 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:23.174512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:23.181632 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c30e-fc60-4491-af61-e50ec3fa217d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:23.181812 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 96/197] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:23.182864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:23.233123 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f908d4c-945a-442e-8edb-f7184ce71cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:23.233816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f908d4c-945a-442e-8edb-f7184ce71cb8 None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:23.234100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f908d4c-945a-442e-8edb-f7184ce71cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:23.234376 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f908d4c-945a-442e-8edb-f7184ce71cb8 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:23.235095 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f908d4c-945a-442e-8edb-f7184ce71cb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:23.237422 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f908d4c-945a-442e-8edb-f7184ce71cb8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:23.267654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 102/198] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:30:23 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:23.316984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62426-3684-477a-9536-b7f84635cc6b None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:23.317442 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62426-3684-477a-9536-b7f84635cc6b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:23.317546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f62426-3684-477a-9536-b7f84635cc6b None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:23.319394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 103/199] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:23.326498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388119-ce8b-423b-b23b-7fcaa3a07723 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:23.326498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388119-ce8b-423b-b23b-7fcaa3a07723 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:23.326750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388119-ce8b-423b-b23b-7fcaa3a07723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:23.346918 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-b9388119-ce8b-423b-b23b-7fcaa3a07723 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:23.347286 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb87fb-bd8a-4ecd-b51f-4b0d19af5be4 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:23.348365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-b9388119-ce8b-423b-b23b-7fcaa3a07723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:23.391331 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:23.392251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:23.392536 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:23.392814 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:23.394191 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:23.395761 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:23.397809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 97/200] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:23 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:23.403643 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:23.453636 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 104/201] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:23.472120 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:23.479855 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9388119-ce8b-423b-b23b-7fcaa3a07723 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:23.537226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f02283-bb04-4d19-81b8-3acab67a430b None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:23.593599 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:23.594275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:23.594566 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:23.594852 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:23.597822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] RBAC: Adding query filter params (role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=a9c86a84044549a1b0355bf7215238e1) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:23.598208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:23.599718 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:23.608705 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 98/202] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:23 2022] GET /identity/v3/role_assignments?user.id=a9c86a84044549a1b0355bf7215238e1&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=62b39839f9fe48649ad91d0114c66534 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:23.624559 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:23.657081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9388119-ce8b-423b-b23b-7fcaa3a07723 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:23.709290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:23.710114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:23.710408 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:23.710686 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:23.724441 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:23.732935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:23.733869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:23.735064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 105/203] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:30:23.740391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:23.876550 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c50b19-cd8f-40f5-8cb1-5ef25eba4c24 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:23.905376 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:23.926316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:23.927343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:23.927940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:23.928697 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:23.929677 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:23.930190 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:23.931956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:23.947196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 99/204] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:23.957407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:24.117379 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bf256-817b-41c9-acd1-12793f91b0bf None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:24.170376 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:24.171649 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:24.172194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:24.172701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] PATH_INFO: `/v3/users/b7ded1e020604c608db2d51d19e6ab7b` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:24.174112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] RBAC: Authorizing `identity:get_user(user_id=b7ded1e020604c608db2d51d19e6ab7b)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:24.175804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:24.177681 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 106/205] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:23 2022] GET /identity/v3/users/b7ded1e020604c608db2d51d19e6ab7b => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:24.185358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:24.326316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1959c2-a4b1-48b0-870e-33417839ba0c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:24.374776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:24.375884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:24.383945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:24.384450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:24.464209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:24.490016 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:24.492224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:24.634348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 100/206] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:24.640307 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:24.664484 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:24.993868 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902820-7216-4058-af7b-632457ddf4ca None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:25.112961 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7391ae3-5e22-4602-baed-f55e5d710fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:25.113844 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391ae3-5e22-4602-baed-f55e5d710fb6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:25.114125 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391ae3-5e22-4602-baed-f55e5d710fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:25.114399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7391ae3-5e22-4602-baed-f55e5d710fb6 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:25.120480 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7391ae3-5e22-4602-baed-f55e5d710fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:25.122472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7391ae3-5e22-4602-baed-f55e5d710fb6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:25.124227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 107/207] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:24 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:25.134089 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:25.348098 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:25.413968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0b12b-fac8-493f-a0a0-e74bb68a7fa5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:25.483709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b4e2d-1726-4efb-b113-c1d2aeaf11cb None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:25.484090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b4e2d-1726-4efb-b113-c1d2aeaf11cb None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:25.484302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b4e2d-1726-4efb-b113-c1d2aeaf11cb None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:25.485833 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 108/208] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:25.491409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d272-4f17-4922-a3e4-1fbb5ad73f55 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:25.491951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d272-4f17-4922-a3e4-1fbb5ad73f55 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:25.492434 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d272-4f17-4922-a3e4-1fbb5ad73f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:25.514782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:25.515448 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:25.519770 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:25.519770 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:25.519959 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] RBAC: Adding query filter params (role.id=61243bfc1a6942c98b2e8f3d6fb716c0, scope.project.id=07eb2ce2492b445686e24aed81fe97c8, user.id=b7ded1e020604c608db2d51d19e6ab7b) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:25.520198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:25.521778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:25.524473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-dde0d272-4f17-4922-a3e4-1fbb5ad73f55 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:25.525773 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-dde0d272-4f17-4922-a3e4-1fbb5ad73f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:25.538138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 101/209] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:25 2022] GET /identity/v3/role_assignments?user.id=b7ded1e020604c608db2d51d19e6ab7b&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=61243bfc1a6942c98b2e8f3d6fb716c0 => generated 608 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:25.678789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 109/210] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:25.723460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:25.905252 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e352ad2-426c-42b4-9ac9-b19986cfcaa4 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:25.947354 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07800a30-0435-43a8-b8b3-366a89664c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:25.948234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800a30-0435-43a8-b8b3-366a89664c4b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:25.948957 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800a30-0435-43a8-b8b3-366a89664c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:25.949247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800a30-0435-43a8-b8b3-366a89664c4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:25.967190 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07800a30-0435-43a8-b8b3-366a89664c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-07800a30-0435-43a8-b8b3-366a89664c4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:25.978850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:25.979685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:25.980934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 102/211] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:25.987491 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0d272-4f17-4922-a3e4-1fbb5ad73f55 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:26.016102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:26.418197 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0d272-4f17-4922-a3e4-1fbb5ad73f55 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:26.425664 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1636-c8fc-420a-a2c6-7f2348f0482a None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.426173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1636-c8fc-420a-a2c6-7f2348f0482a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.426387 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1636-c8fc-420a-a2c6-7f2348f0482a None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.436252 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 103/212] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:26.443832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c86cf-5119-4fa3-85c7-59ec2819ac8f None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.444142 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c86cf-5119-4fa3-85c7-59ec2819ac8f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.444409 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c86cf-5119-4fa3-85c7-59ec2819ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.463227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:26.463961 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.464254 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.464537 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.465287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:26.466322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:26.467709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:26.474544 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:26.477563 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 110/213] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:26.486098 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:26.504291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-a36c86cf-5119-4fa3-85c7-59ec2819ac8f None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:26.505739 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-a36c86cf-5119-4fa3-85c7-59ec2819ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:26.569298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:26.595595 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 104/214] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:26.597477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50c90-0b4e-40ca-b22b-8c9a9b5550b4 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.597953 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50c90-0b4e-40ca-b22b-8c9a9b5550b4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.598235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50c90-0b4e-40ca-b22b-8c9a9b5550b4 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.599509 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 105/215] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:26.604787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49216a-d406-4e00-b260-6bee460cb3aa None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.605375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49216a-d406-4e00-b260-6bee460cb3aa None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.605882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49216a-d406-4e00-b260-6bee460cb3aa None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.607931 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 106/216] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:26.609492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f03f-759d-4899-a198-aa16d7e2ba80 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.609880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f03f-759d-4899-a198-aa16d7e2ba80 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.610233 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f03f-759d-4899-a198-aa16d7e2ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.624884 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12366d-c8ea-40e3-9e82-a0b888b4b1f7 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:26.639416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6d21f03f-759d-4899-a198-aa16d7e2ba80 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:26.640829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6d21f03f-759d-4899-a198-aa16d7e2ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:26.664729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa549f5-134a-4f66-af75-0aedd5a4da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:26.665606 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa549f5-134a-4f66-af75-0aedd5a4da31 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.665893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa549f5-134a-4f66-af75-0aedd5a4da31 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.666170 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa549f5-134a-4f66-af75-0aedd5a4da31 None admin] PATH_INFO: `/v3/users/a9c86a84044549a1b0355bf7215238e1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.667372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa549f5-134a-4f66-af75-0aedd5a4da31 None admin] RBAC: Authorizing `identity:get_user(user_id=a9c86a84044549a1b0355bf7215238e1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:26.669535 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa549f5-134a-4f66-af75-0aedd5a4da31 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:26.672896 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 111/217] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:26 2022] GET /identity/v3/users/a9c86a84044549a1b0355bf7215238e1 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:26.674300 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9356e-4866-4a2d-b3d2-69f2746d2d88 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.674632 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9356e-4866-4a2d-b3d2-69f2746d2d88 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.674875 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9356e-4866-4a2d-b3d2-69f2746d2d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.694634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-d6f9356e-4866-4a2d-b3d2-69f2746d2d88 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:26.695889 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-d6f9356e-4866-4a2d-b3d2-69f2746d2d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:26.728274 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 107/218] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:26.729196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f03f-759d-4899-a198-aa16d7e2ba80 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:26.798913 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 112/219] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:26.799656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9356e-4866-4a2d-b3d2-69f2746d2d88 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:26.846103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:26.900012 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f03f-759d-4899-a198-aa16d7e2ba80 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:26.924486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:26.947504 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:26.948423 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:26.948763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:26.949042 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:26.961576 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9356e-4866-4a2d-b3d2-69f2746d2d88 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:26.965067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:26.974609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:26.975532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:26.976335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 108/220] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:26.976982 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.006216 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.007087 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.007482 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.007777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.009226 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.010674 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.013238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 113/221] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:26 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:27.013776 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.113854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245dddf-e26c-495d-bdd2-da806797c9c0 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.152315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:27.158684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5323-44f6-4881-8b4c-0b7dc6a3c6d1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.172611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.173650 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.173941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.174288 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.185386 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:27.193473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:27.194327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:27.195092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 109/222] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:27.195795 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.203416 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.204244 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.204528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.204830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.205999 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.207420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.211897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 114/223] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:27.211897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.218748 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:27.322351 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d395c-3806-45b4-bcbb-1c2fa4cef42a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.324734 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7e86c-0819-4bb2-b309-6a7d2996e5cc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.361570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.362465 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.362752 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.363033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785/users/a9c86a84044549a1b0355bf7215238e1/roles/8442e7332b934407beff8c3564575b62` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.363787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.364445 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.364736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.365018 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.365113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdc3d7568314f38be815c34893be785, user_id=a9c86a84044549a1b0355bf7215238e1, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.365767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:27.366081 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.366450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.367447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.376586 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 110/224] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:27.377459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.380514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 115/225] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:27 2022] PUT /identity/v3/projects/5bdc3d7568314f38be815c34893be785/users/a9c86a84044549a1b0355bf7215238e1/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:27.381238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.445614 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:27.525568 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:27.541854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a016c2a-1748-459e-83ea-aa447cd707f9 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.594344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c724-eb70-4d45-9b30-018d2bd020d3 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.597566 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.598352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.598713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.599064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.599942 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:27.600321 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.601776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.611494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 111/226] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:27.612377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.637370 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.638081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.638356 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.638639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.639359 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.640872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.668111 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 116/227] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:30:27 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:27.668111 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.747526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ac8ce-4081-439e-b421-f11744cd2e48 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.758272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:27.794601 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.795949 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.796632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.797151 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] PATH_INFO: `/v3/users/f09e1c959f9a49dc8a36f48c1b67ea4e` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.813913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=f09e1c959f9a49dc8a36f48c1b67ea4e)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.815819 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.817904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 112/228] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:27 2022] GET /identity/v3/users/f09e1c959f9a49dc8a36f48c1b67ea4e => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:27.822529 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23a0f2-ed91-489a-ad13-bc12b733dd68 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:27.824278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.848253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:27.868967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:27.870821 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:27.871110 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:27.871395 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] PATH_INFO: `/v3/users/a9c86a84044549a1b0355bf7215238e1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:27.873191 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] RBAC: Authorizing `identity:get_user(user_id=a9c86a84044549a1b0355bf7215238e1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:27.874653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:27.876512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 117/229] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:27 2022] GET /identity/v3/users/a9c86a84044549a1b0355bf7215238e1 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:27.881851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:27.975491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd40ed-dc23-4f27-883b-5f2f2652a6e6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:28.027731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:28.028758 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:28.029046 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:28.029327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:28.036637 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474986db-5ab2-42a7-aeea-816e7f20a25a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:28.088739 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:28.090262 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:28.091084 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:28.091371 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:28.093630 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:28.095136 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:28.095688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:28.099863 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 118/230] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:27 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:28.108368 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:28.151268 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:28.153554 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:28.187659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:28.239950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a2ec1-6a10-4fbf-b2ce-f64350902826 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:28.275227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:28.276045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 113/231] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:28.276183 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:28.276443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:28.276726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785/users/a9c86a84044549a1b0355bf7215238e1/roles/62b39839f9fe48649ad91d0114c66534` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:28.279219 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdc3d7568314f38be815c34893be785, user_id=a9c86a84044549a1b0355bf7215238e1, role_id=62b39839f9fe48649ad91d0114c66534)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:28.287810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:28.289056 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:28.296702 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 119/232] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:28 2022] PUT /identity/v3/projects/5bdc3d7568314f38be815c34893be785/users/a9c86a84044549a1b0355bf7215238e1/roles/62b39839f9fe48649ad91d0114c66534 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:28.425503 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:28.492120 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333922af-57f6-4c68-8d57-cc2f01997753 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:28.541994 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ab691-7c16-4864-86b0-bf896c492c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:28.542790 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab691-7c16-4864-86b0-bf896c492c41 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:28.543078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab691-7c16-4864-86b0-bf896c492c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:28.543357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ab691-7c16-4864-86b0-bf896c492c41 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:28.544647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ab691-7c16-4864-86b0-bf896c492c41 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:28.546112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ab691-7c16-4864-86b0-bf896c492c41 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:28.548025 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 114/233] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:28 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:28.553979 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:28.690090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979b934-3520-41cf-99ab-5ffbc7ddb83d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:28.724151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:28.759447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71134e-630f-4f4a-8c8e-29c47423a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:28.760160 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71134e-630f-4f4a-8c8e-29c47423a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:28.760455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71134e-630f-4f4a-8c8e-29c47423a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:28.760739 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71134e-630f-4f4a-8c8e-29c47423a5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:28.761583 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71134e-630f-4f4a-8c8e-29c47423a5f6 None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=f09e1c959f9a49dc8a36f48c1b67ea4e) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:28.761900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71134e-630f-4f4a-8c8e-29c47423a5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:28.763420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71134e-630f-4f4a-8c8e-29c47423a5f6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:28.776287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 120/234] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:28 2022] GET /identity/v3/role_assignments?user.id=f09e1c959f9a49dc8a36f48c1b67ea4e&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:30.161535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e5b9-6587-4871-9604-1850f65654d7 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:30.162085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e5b9-6587-4871-9604-1850f65654d7 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:30.162085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e5b9-6587-4871-9604-1850f65654d7 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:30.163779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 115/235] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:30.169288 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aedb8-2969-4f43-a8fc-9de66ff298cf None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:30.169719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aedb8-2969-4f43-a8fc-9de66ff298cf None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:30.169897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43aedb8-2969-4f43-a8fc-9de66ff298cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:30.200736 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e43aedb8-2969-4f43-a8fc-9de66ff298cf None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:30.201921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e43aedb8-2969-4f43-a8fc-9de66ff298cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:30.345251 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 121/236] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:30.389441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180e5b9-6587-4871-9604-1850f65654d7 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:30.540440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180e5b9-6587-4871-9604-1850f65654d7 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:30.594839 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:30.595710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:30.595967 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:30.596250 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:30.601374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:30.601566 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555992e3-5a90-468f-8fd2-68eb05518470 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:30.602489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555992e3-5a90-468f-8fd2-68eb05518470 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:30.602864 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555992e3-5a90-468f-8fd2-68eb05518470 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:30.604538 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 122/237] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:30.611156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c638-1ea4-4dfd-bce9-14772ed7e796 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:30.611453 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c638-1ea4-4dfd-bce9-14772ed7e796 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:30.611764 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c638-1ea4-4dfd-bce9-14772ed7e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:30.618044 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:30.627211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:30.628171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:30.628940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 116/238] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:30.639383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:30.648343 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-39b0c638-1ea4-4dfd-bce9-14772ed7e796 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:30.651167 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-39b0c638-1ea4-4dfd-bce9-14772ed7e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:30.810137 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 123/239] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:30.836124 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b3f40-d67a-4d7e-81d8-172090ba2d43 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:30.851261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c638-1ea4-4dfd-bce9-14772ed7e796 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:30.875171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae907c-816a-4d40-81c1-d0e1e460bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:30.876408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae907c-816a-4d40-81c1-d0e1e460bca3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:30.877023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae907c-816a-4d40-81c1-d0e1e460bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:30.877311 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae907c-816a-4d40-81c1-d0e1e460bca3 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:30.878201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae907c-816a-4d40-81c1-d0e1e460bca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:30.878923 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae907c-816a-4d40-81c1-d0e1e460bca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:30.880663 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae907c-816a-4d40-81c1-d0e1e460bca3 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:30.892331 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 117/240] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:30.893952 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422833-d748-4dd7-a590-50628b4b9bba None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:30.894248 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422833-d748-4dd7-a590-50628b4b9bba None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:30.894534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422833-d748-4dd7-a590-50628b4b9bba None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:30.896750 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 118/241] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:30.901168 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37422833-d748-4dd7-a590-50628b4b9bba None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:30.929486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:30.988268 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:31.026357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c638-1ea4-4dfd-bce9-14772ed7e796 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.046492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37422833-d748-4dd7-a590-50628b4b9bba None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.073047 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527bbf5-99c1-48e1-aa7c-49977b7d44af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.074631 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527bbf5-99c1-48e1-aa7c-49977b7d44af None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.075455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527bbf5-99c1-48e1-aa7c-49977b7d44af None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.075986 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527bbf5-99c1-48e1-aa7c-49977b7d44af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.095091 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527bbf5-99c1-48e1-aa7c-49977b7d44af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:31.102629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-d527bbf5-99c1-48e1-aa7c-49977b7d44af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:31.103134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:31.104258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:31.105108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 124/242] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:31.105774 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8892b4-0577-4a14-bf23-88f414019eee None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.106898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8892b4-0577-4a14-bf23-88f414019eee None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.106898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8892b4-0577-4a14-bf23-88f414019eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.108138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.108805 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.109445 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] PATH_INFO: `/v3/users/a9c86a84044549a1b0355bf7215238e1` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.111145 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] RBAC: Authorizing `identity:get_user(user_id=a9c86a84044549a1b0355bf7215238e1)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:31.114361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:31.116735 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 119/243] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:30 2022] GET /identity/v3/users/a9c86a84044549a1b0355bf7215238e1 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:31.117786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.125241 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-ef8892b4-0577-4a14-bf23-88f414019eee None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:31.126424 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-ef8892b4-0577-4a14-bf23-88f414019eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:31.206276 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 125/244] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:31.207017 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8892b4-0577-4a14-bf23-88f414019eee None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.244266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:31.244453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e1de-c190-415c-9f0a-4b3724bb8598 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.269387 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:31.281245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c53f6-daa0-454c-bbc7-842008b316d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.281921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c53f6-daa0-454c-bbc7-842008b316d9 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.282210 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c53f6-daa0-454c-bbc7-842008b316d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.282494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c53f6-daa0-454c-bbc7-842008b316d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.283241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c53f6-daa0-454c-bbc7-842008b316d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:31.283552 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c53f6-daa0-454c-bbc7-842008b316d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:31.285004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c53f6-daa0-454c-bbc7-842008b316d9 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:31.294784 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 120/245] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:31.295351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424197a-c1cb-40fb-a057-137e1475fafe None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.295649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424197a-c1cb-40fb-a057-137e1475fafe None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.296165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424197a-c1cb-40fb-a057-137e1475fafe None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.297568 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 121/246] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:31.298285 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424197a-c1cb-40fb-a057-137e1475fafe None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.331580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8892b4-0577-4a14-bf23-88f414019eee None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.369831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208da0-7750-4643-b380-bb9a5d556c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.370557 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208da0-7750-4643-b380-bb9a5d556c17 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.370840 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208da0-7750-4643-b380-bb9a5d556c17 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.371121 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208da0-7750-4643-b380-bb9a5d556c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.416501 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424197a-c1cb-40fb-a057-137e1475fafe None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.449306 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a208da0-7750-4643-b380-bb9a5d556c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:31.451310 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a208da0-7750-4643-b380-bb9a5d556c17 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:31.451595 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.452486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.452834 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.453181 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.454403 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:31.455952 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:31.457644 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 122/247] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:31.458464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.494715 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:31.526957 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:31.571892 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de78bb-049c-49f7-b35f-028de67fd579 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.572732 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 126/248] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:31.575363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235aa9-742c-4e26-a241-3d6b84b55217 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.575363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235aa9-742c-4e26-a241-3d6b84b55217 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.575363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235aa9-742c-4e26-a241-3d6b84b55217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.591712 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-43235aa9-742c-4e26-a241-3d6b84b55217 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:31.592921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-43235aa9-742c-4e26-a241-3d6b84b55217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:31.609077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.609956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.610248 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.610529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] PATH_INFO: `/v3/users/736439e1099043769b4c5fe3155a99b4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.624577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] RBAC: Authorizing `identity:get_user(user_id=736439e1099043769b4c5fe3155a99b4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:31.625983 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:31.627871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 123/249] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:31 2022] GET /identity/v3/users/736439e1099043769b4c5fe3155a99b4 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:31.628628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.662643 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 127/250] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:31.664006 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8700ee-cc28-46ed-8943-52064365c4f9 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.664298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8700ee-cc28-46ed-8943-52064365c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.664580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8700ee-cc28-46ed-8943-52064365c4f9 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.669013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 128/251] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:31.669013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8700ee-cc28-46ed-8943-52064365c4f9 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.731293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d6f48-6950-4b8a-b3bc-bee3840dae74 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.743865 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:31.744375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:31.765943 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.766606 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.766890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.767166 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.767916 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:31.769437 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:31.785431 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8700ee-cc28-46ed-8943-52064365c4f9 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.790441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 124/252] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:30:31 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:31.791260 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.824368 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a3ff4-1458-4972-8dc3-f5170790170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.826027 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a3ff4-1458-4972-8dc3-f5170790170a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.826380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a3ff4-1458-4972-8dc3-f5170790170a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.827532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a3ff4-1458-4972-8dc3-f5170790170a None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.828240 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a3ff4-1458-4972-8dc3-f5170790170a None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:31.829896 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a3ff4-1458-4972-8dc3-f5170790170a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:31.837175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 129/253] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:31 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:31.837175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca96b-410f-4bdc-8e3d-1a7c92d779b6 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.837175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca96b-410f-4bdc-8e3d-1a7c92d779b6 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.837175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca96b-410f-4bdc-8e3d-1a7c92d779b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:31.857758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-ba3ca96b-410f-4bdc-8e3d-1a7c92d779b6 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:31.858983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-ba3ca96b-410f-4bdc-8e3d-1a7c92d779b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:31.921805 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d76538-1a31-4c08-a5b9-38cf4be23450 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:31.937989 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 130/254] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:31.938665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ca96b-410f-4bdc-8e3d-1a7c92d779b6 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:31.973863 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:31.974809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:31.975236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:31.975643 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.010581 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:32.021015 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:32.066624 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ca96b-410f-4bdc-8e3d-1a7c92d779b6 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.076168 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:32.077311 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:32.117885 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:32.119540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:32.120194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:32.120540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.138785 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:32.146655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:32.147547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:32.148579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 131/255] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:32.153540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.227056 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 125/256] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:32.228578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.275956 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a718e9-c1a9-40da-bff0-8e67fd73cca5 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.303354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:32.314467 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:32.327077 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:32.328571 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:32.329026 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:32.329452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.331201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=a9c86a84044549a1b0355bf7215238e1) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:32.331667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:32.334010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:32.342651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 132/257] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/role_assignments?user.id=a9c86a84044549a1b0355bf7215238e1&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=8442e7332b934407beff8c3564575b62 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:32.343698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.374367 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5369-504c-4283-8ebf-4091aa967e46 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.453978 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:32.456705 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:32.457984 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:32.458492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.480466 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:32.489160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:32.490117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:32.490887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:32.497897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 126/258] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:32.499961 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.572721 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76135e-f859-4cfc-bb73-03868050e5c0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.619403 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:32.620394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:32.620685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:32.620962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.622251 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:32.622677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:32.624115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:32.633688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 133/259] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:32.634450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.652369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5226ade-2612-43d1-ad45-288568313747 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.694422 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:32.697085 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:32.707011 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:32.708699 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:32.709485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:32.709963 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.711377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:32.713604 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:32.718686 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 127/260] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:32.719907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.774000 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddb82-3025-4d01-bd30-39c085779edd None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.821078 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:32.822134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:32.822693 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:32.823171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.825562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:32.826082 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:32.827835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:32.837989 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 134/261] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:32.839230 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.862966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137ce26-9eb2-40fe-9917-e00b31f80498 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.915350 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:32.916627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:32.916917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:32.917192 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] PATH_INFO: `/v3/users/a9c86a84044549a1b0355bf7215238e1` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:32.919472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] RBAC: Authorizing `identity:get_user(user_id=a9c86a84044549a1b0355bf7215238e1)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:32.920964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:32.922596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 128/262] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/users/a9c86a84044549a1b0355bf7215238e1 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:32.923357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:32.964500 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa0568-34a0-4210-a4da-10da66d48b0f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:32.976914 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:32.999411 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:33.015119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:33.015809 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:33.016099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:33.016376 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:33.018005 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] RBAC: Adding query filter params (role.id=61243bfc1a6942c98b2e8f3d6fb716c0, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=736439e1099043769b4c5fe3155a99b4) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:33.018328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:33.019788 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:33.028197 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 135/263] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/role_assignments?user.id=736439e1099043769b4c5fe3155a99b4&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=61243bfc1a6942c98b2e8f3d6fb716c0 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:33.029193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:33.054103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30908eef-933e-40b2-8e3f-31b3dd21ac9f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:33.142097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:33.143492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:33.144008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:33.144489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] PATH_INFO: `/v3/users/f09e1c959f9a49dc8a36f48c1b67ea4e` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:33.152412 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] RBAC: Authorizing `identity:get_user(user_id=f09e1c959f9a49dc8a36f48c1b67ea4e)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:33.154895 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:33.159765 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb0a15-a2e8-4906-a658-20c0dbfd3043 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:33.161969 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 129/264] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:32 2022] GET /identity/v3/users/f09e1c959f9a49dc8a36f48c1b67ea4e => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:33.167631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:33.206703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:33.207086 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:33.207364 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:33.208505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:33.267377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:33.292000 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:33.293999 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:33.411226 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 136/265] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:33.416743 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:33.517130 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c655db-55c9-47cc-b52f-f2273cd9e9fc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:33.527182 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:33.575722 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3818a0-1bfa-42bd-80a6-b424559e6d68 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:33.593888 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:33.606510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:33.608239 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:33.611756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:33.611756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:33.615762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:33.615762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:33.618003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 130/266] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:33 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:33.628760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:33.643573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:33.644476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:33.645571 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:33.645571 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:33.647607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:33.651758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:33.651758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 137/267] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:33 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:33.657543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:33.767764 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9708-d138-4d7a-a8d9-bced7c5cbcf6 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:33.803256 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cc04d-0497-4a38-8051-559a5088559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:33.803952 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc04d-0497-4a38-8051-559a5088559e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:33.804243 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc04d-0497-4a38-8051-559a5088559e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:33.805546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cc04d-0497-4a38-8051-559a5088559e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:33.805546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cc04d-0497-4a38-8051-559a5088559e None admin] RBAC: Adding query filter params (role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=a9c86a84044549a1b0355bf7215238e1) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:33.805719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cc04d-0497-4a38-8051-559a5088559e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:33.807212 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cc04d-0497-4a38-8051-559a5088559e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:33.814442 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 138/268] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:33 2022] GET /identity/v3/role_assignments?user.id=a9c86a84044549a1b0355bf7215238e1&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=62b39839f9fe48649ad91d0114c66534 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:34.008950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f90e5-5de4-4cc6-93e0-6d6d0a9d19a0 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:34.051634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49063ba2-7ce1-4a70-9e72-32381b8c42f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:34.052575 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063ba2-7ce1-4a70-9e72-32381b8c42f0 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.052861 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063ba2-7ce1-4a70-9e72-32381b8c42f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.053142 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063ba2-7ce1-4a70-9e72-32381b8c42f0 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785/users/f09e1c959f9a49dc8a36f48c1b67ea4e/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.055115 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49063ba2-7ce1-4a70-9e72-32381b8c42f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdc3d7568314f38be815c34893be785, user_id=f09e1c959f9a49dc8a36f48c1b67ea4e, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:34.056619 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49063ba2-7ce1-4a70-9e72-32381b8c42f0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:34.074047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 131/269] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:33 2022] PUT /identity/v3/projects/5bdc3d7568314f38be815c34893be785/users/f09e1c959f9a49dc8a36f48c1b67ea4e/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:30:34.422053 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0598279-3759-4b08-ba5e-67ff413ab51e None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.422575 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0598279-3759-4b08-ba5e-67ff413ab51e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.422647 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0598279-3759-4b08-ba5e-67ff413ab51e None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.424929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 139/270] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:34.431813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b3fb8-8f35-428d-966f-08901b460474 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.431813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b3fb8-8f35-428d-966f-08901b460474 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.431813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b3fb8-8f35-428d-966f-08901b460474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.448862 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-fd3b3fb8-8f35-428d-966f-08901b460474 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:34.450909 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-fd3b3fb8-8f35-428d-966f-08901b460474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:34.507545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b780da1-865d-4d7a-a633-dd9911241369 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.508165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b780da1-865d-4d7a-a633-dd9911241369 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.508621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b780da1-865d-4d7a-a633-dd9911241369 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.510013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 140/271] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:34.515994 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58e8b1-a4ca-480f-8106-c738d8116691 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.516281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58e8b1-a4ca-480f-8106-c738d8116691 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.516563 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58e8b1-a4ca-480f-8106-c738d8116691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.517824 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:34.523626 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:34.537069 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-1b58e8b1-a4ca-480f-8106-c738d8116691 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:34.538278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 132/272] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:34.538392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-1b58e8b1-a4ca-480f-8106-c738d8116691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:34.562438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b3fb8-8f35-428d-966f-08901b460474 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:34.623767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 141/273] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:34.648486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58e8b1-a4ca-480f-8106-c738d8116691 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:34.680358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b3fb8-8f35-428d-966f-08901b460474 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:34.718665 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:34.719630 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.719946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.720230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.731990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:34.740518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:34.741370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:34.742138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:34.747248 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 133/274] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:30:34.748165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:34.755685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58e8b1-a4ca-480f-8106-c738d8116691 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:34.791356 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:34.792200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.792483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.792758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.794269 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:34.795799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:34.797421 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 142/275] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:34.803037 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:34.804605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:34.805930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:34.864828 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f8e58-3f3d-4a97-9b32-50865ba77087 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:34.900639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:34.901634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.902067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.902556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.903480 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:34.903963 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:34.905514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:34.914430 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 134/276] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:34.919036 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad1ae5-84b0-435a-9a7a-db3f0c6f758d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:34.921026 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:34.966873 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:34.967534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:34.967871 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:34.968151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:34.969027 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:34.973308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:35.005996 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 143/277] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:30:34 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:35.047354 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46c4a8-c11f-4beb-946d-dc4b631b6867 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:35.068146 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:35.088474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35cd6c-e998-4048-aacd-3360332f953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:35.089508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35cd6c-e998-4048-aacd-3360332f953c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:35.089829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35cd6c-e998-4048-aacd-3360332f953c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:35.090155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35cd6c-e998-4048-aacd-3360332f953c None admin] PATH_INFO: `/v3/users/f3ad3e4d33fd4947a32a686272968460` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:35.106534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35cd6c-e998-4048-aacd-3360332f953c None admin] RBAC: Authorizing `identity:get_user(user_id=f3ad3e4d33fd4947a32a686272968460)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:35.108192 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35cd6c-e998-4048-aacd-3360332f953c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:35.110352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 135/278] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:34 2022] GET /identity/v3/users/f3ad3e4d33fd4947a32a686272968460 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:35.116464 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:35.191779 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:35.240102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e5a50-15fd-4adb-9bc2-d71e7611da6d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:35.275769 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07169ad1-bfd6-434e-a455-5e1710dd1aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:35.276447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07169ad1-bfd6-434e-a455-5e1710dd1aa4 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:35.276730 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07169ad1-bfd6-434e-a455-5e1710dd1aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:35.277006 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07169ad1-bfd6-434e-a455-5e1710dd1aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:35.278327 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07169ad1-bfd6-434e-a455-5e1710dd1aa4 None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, user.id=f3ad3e4d33fd4947a32a686272968460, scope.system=all) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:35.278857 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07169ad1-bfd6-434e-a455-5e1710dd1aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:35.280519 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07169ad1-bfd6-434e-a455-5e1710dd1aa4 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:35.286938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 144/279] 10.222.0.94 () {56 vars in 1308 bytes} [Fri Jul 15 15:30:35 2022] GET /identity/v3/role_assignments?user.id=f3ad3e4d33fd4947a32a686272968460&scope.system=all&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:35.615774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848767b3-7ee4-4719-b472-111a6cd69d56 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:35.617120 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848767b3-7ee4-4719-b472-111a6cd69d56 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:35.617848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848767b3-7ee4-4719-b472-111a6cd69d56 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:35.619714 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 136/280] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:35.625432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d176125-02c3-4e96-8e23-f9c91a56c1e3 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:35.625841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d176125-02c3-4e96-8e23-f9c91a56c1e3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:35.626009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d176125-02c3-4e96-8e23-f9c91a56c1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:35.648731 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8d176125-02c3-4e96-8e23-f9c91a56c1e3 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:35.649964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8d176125-02c3-4e96-8e23-f9c91a56c1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:35.749727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 145/281] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:35.789347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848767b3-7ee4-4719-b472-111a6cd69d56 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:35.929958 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848767b3-7ee4-4719-b472-111a6cd69d56 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:36.018043 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:36.018859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:36.019145 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:36.019421 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:36.042608 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:36.051053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:36.051960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:36.052746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:36.056621 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 137/282] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:36.065086 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d176125-02c3-4e96-8e23-f9c91a56c1e3 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:36.184641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:36.292965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d176125-02c3-4e96-8e23-f9c91a56c1e3 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:36.374522 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d7d3c-15b2-48a7-b72c-ce87ddbea683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:36.375219 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d7d3c-15b2-48a7-b72c-ce87ddbea683 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:36.375503 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d7d3c-15b2-48a7-b72c-ce87ddbea683 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:36.375803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d7d3c-15b2-48a7-b72c-ce87ddbea683 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:36.376565 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d7d3c-15b2-48a7-b72c-ce87ddbea683 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:36.376874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d7d3c-15b2-48a7-b72c-ce87ddbea683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:36.379109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d7d3c-15b2-48a7-b72c-ce87ddbea683 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:36.395080 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 146/283] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:36.400400 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:36.467661 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:36.516545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606a7d-73be-48e7-892b-3f28f16f4f2d None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:36.520315 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606a7d-73be-48e7-892b-3f28f16f4f2d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:36.520820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606a7d-73be-48e7-892b-3f28f16f4f2d None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:36.527756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 147/284] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:36.533131 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5dfc-0760-4261-a215-693ec0828b02 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:36.533517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5dfc-0760-4261-a215-693ec0828b02 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:36.533804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5dfc-0760-4261-a215-693ec0828b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:36.551700 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137ea44-6684-4e1f-8358-98038edc9ac3 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:36.579834 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-5d3d5dfc-0760-4261-a215-693ec0828b02 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:36.581150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-5d3d5dfc-0760-4261-a215-693ec0828b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:36.586735 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:36.587625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:36.587937 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:36.588217 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] PATH_INFO: `/v3/users/736439e1099043769b4c5fe3155a99b4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:36.589473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] RBAC: Authorizing `identity:get_user(user_id=736439e1099043769b4c5fe3155a99b4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:36.591010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:36.592994 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 138/285] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:36 2022] GET /identity/v3/users/736439e1099043769b4c5fe3155a99b4 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:36.598342 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:36.737724 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 148/286] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:36.765442 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5dfc-0760-4261-a215-693ec0828b02 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:36.794976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:36.802361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdad7a-1269-4ab5-b6b0-a82f97bd86e8 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:36.848127 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:36.879763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:36.879763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:36.879763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:36.879763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:36.880154 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:36.882425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:36.882425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 139/287] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:36 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:36.888841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:36.950167 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5dfc-0760-4261-a215-693ec0828b02 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:37.031377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:37.032126 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.032409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.032679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.050693 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:37.058622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:37.059473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:37.060287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:37.072874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 149/288] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:37.076254 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:37.081385 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedaf0a-1761-41fb-9411-b359976716a9 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:37.152170 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:37.153127 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.153416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.153691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785/users/736439e1099043769b4c5fe3155a99b4/roles/61243bfc1a6942c98b2e8f3d6fb716c0` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.158990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdc3d7568314f38be815c34893be785, user_id=736439e1099043769b4c5fe3155a99b4, role_id=61243bfc1a6942c98b2e8f3d6fb716c0)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:37.160488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:37.185901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 140/289] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:30:36 2022] PUT /identity/v3/projects/5bdc3d7568314f38be815c34893be785/users/736439e1099043769b4c5fe3155a99b4/roles/61243bfc1a6942c98b2e8f3d6fb716c0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:30:37.239841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02753642-bcfc-4b92-aae5-6620231a28c4 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:37.244083 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:37.278532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:37.279456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.279929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.280397 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.281338 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:37.281873 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:37.283403 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:37.293584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 150/290] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:37.299597 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:37.368139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:37.496643 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed6d6-70b6-4673-ac41-be70e5f39bb2 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:37.536602 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd61121-3b0d-4a65-a8d2-01e69440e7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:37.537710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61121-3b0d-4a65-a8d2-01e69440e7a1 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.538149 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61121-3b0d-4a65-a8d2-01e69440e7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.538573 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd61121-3b0d-4a65-a8d2-01e69440e7a1 None admin] PATH_INFO: `/v3/users/f09e1c959f9a49dc8a36f48c1b67ea4e` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.540144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd61121-3b0d-4a65-a8d2-01e69440e7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=f09e1c959f9a49dc8a36f48c1b67ea4e)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:37.541748 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd61121-3b0d-4a65-a8d2-01e69440e7a1 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:37.543623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 141/291] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:37 2022] GET /identity/v3/users/f09e1c959f9a49dc8a36f48c1b67ea4e => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:37.551792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:37.773751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b13a6f-d590-489c-a155-991a7656e245 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:37.837676 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4aef2-4690-4c68-8cbe-5c2735d3155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:37.838577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4aef2-4690-4c68-8cbe-5c2735d3155f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.839013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4aef2-4690-4c68-8cbe-5c2735d3155f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.839435 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4aef2-4690-4c68-8cbe-5c2735d3155f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.884174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:37.923390 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4f3ee-7df9-4140-8881-7cc7e8e89ced None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.923945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4f3ee-7df9-4140-8881-7cc7e8e89ced None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.924020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4f3ee-7df9-4140-8881-7cc7e8e89ced None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.925362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 142/292] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:37.933223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4aef2-4690-4c68-8cbe-5c2735d3155f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:37.934799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4aef2-4690-4c68-8cbe-5c2735d3155f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:37.941291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac98438-0cb5-45ea-b2a9-c6768126bf33 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.941882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac98438-0cb5-45ea-b2a9-c6768126bf33 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.942362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac98438-0cb5-45ea-b2a9-c6768126bf33 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.943955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 143/293] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:37.949741 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330228e-7ac1-461e-9555-9610bf6ee34a None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:37.950280 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330228e-7ac1-461e-9555-9610bf6ee34a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:37.950758 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330228e-7ac1-461e-9555-9610bf6ee34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:37.978164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-b330228e-7ac1-461e-9555-9610bf6ee34a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:37.979766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-b330228e-7ac1-461e-9555-9610bf6ee34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:38.053440 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 151/294] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:38.059515 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111e75-f74a-4729-bbb2-f46345d6e363 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.059992 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111e75-f74a-4729-bbb2-f46345d6e363 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.060421 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111e75-f74a-4729-bbb2-f46345d6e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.061607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 144/295] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:38.062908 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330228e-7ac1-461e-9555-9610bf6ee34a None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.078235 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7e111e75-f74a-4729-bbb2-f46345d6e363 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:38.079656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7e111e75-f74a-4729-bbb2-f46345d6e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:38.096633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:38.146161 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:38.154892 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 152/296] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:38.156058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111e75-f74a-4729-bbb2-f46345d6e363 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.211657 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330228e-7ac1-461e-9555-9610bf6ee34a None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.254246 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adfcec-12f6-4fbd-b7c8-20b80eba5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.255210 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adfcec-12f6-4fbd-b7c8-20b80eba5c6c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.255575 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adfcec-12f6-4fbd-b7c8-20b80eba5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.255964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adfcec-12f6-4fbd-b7c8-20b80eba5c6c None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.257439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adfcec-12f6-4fbd-b7c8-20b80eba5c6c None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:38.259827 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adfcec-12f6-4fbd-b7c8-20b80eba5c6c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:38.262200 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 145/297] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:38.265654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7081-9b78-45ff-ba53-b24061b0285a None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.266558 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7081-9b78-45ff-ba53-b24061b0285a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.267224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7081-9b78-45ff-ba53-b24061b0285a None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.269030 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 146/298] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:38.269602 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee7081-9b78-45ff-ba53-b24061b0285a None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.280348 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111e75-f74a-4729-bbb2-f46345d6e363 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.317290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.318102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.318381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.318660 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.329338 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:38.337218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:38.338298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:38.339290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:38.343980 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 153/299] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:38.344857 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.373091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:38.384769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee7081-9b78-45ff-ba53-b24061b0285a None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.409184 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:38.427852 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3a0fc-0cb2-4415-b43a-4fdfd3e21f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.428658 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a0fc-0cb2-4415-b43a-4fdfd3e21f7b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.428950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a0fc-0cb2-4415-b43a-4fdfd3e21f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.429231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3a0fc-0cb2-4415-b43a-4fdfd3e21f7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.441350 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3a0fc-0cb2-4415-b43a-4fdfd3e21f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-fcc3a0fc-0cb2-4415-b43a-4fdfd3e21f7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:38.449813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:38.450711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:38.451491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 147/300] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:38.452670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f09c0-18b6-46aa-a0a1-1e36fdde1aee None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.452765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f09c0-18b6-46aa-a0a1-1e36fdde1aee None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.452982 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f09c0-18b6-46aa-a0a1-1e36fdde1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.463414 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca26fef-987f-4d32-9523-76fb3ac68206 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.472128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-709f09c0-18b6-46aa-a0a1-1e36fdde1aee None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:38.473316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-709f09c0-18b6-46aa-a0a1-1e36fdde1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:38.501631 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.502469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.502872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.503156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.504014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=f09e1c959f9a49dc8a36f48c1b67ea4e) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:38.504334 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:38.505827 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:38.515806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 154/301] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/role_assignments?user.id=f09e1c959f9a49dc8a36f48c1b67ea4e&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:38.515806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.554535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 148/302] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:38.556929 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f09c0-18b6-46aa-a0a1-1e36fdde1aee None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.674719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cf0b7-bcbb-4356-b3d8-57617c2d650a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.682717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:38.698201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:38.710832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f09c0-18b6-46aa-a0a1-1e36fdde1aee None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.717333 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.718019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.718306 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.718584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.719782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:38.719782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:38.721146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:38.731170 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 155/303] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:38.731882 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.756804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.757995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.758280 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.758558 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.759783 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:38.759783 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:38.762671 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:38.773385 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 149/304] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:38.774238 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.882325 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc637-6884-4d00-a7e0-5374f4f918f4 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.890740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786dd1c-a45d-4f99-ae5c-84507a833800 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:38.919959 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.920817 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.921138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.921407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.922545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:38.924089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:38.930238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 156/305] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:38.930238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.935926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:38.936884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:38.937241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:38.937587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] PATH_INFO: `/v3/users/f3ad3e4d33fd4947a32a686272968460` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:38.938850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] RBAC: Authorizing `identity:get_user(user_id=f3ad3e4d33fd4947a32a686272968460)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:38.940519 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:38.942213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 150/306] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/users/f3ad3e4d33fd4947a32a686272968460 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:38.942213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:38.962243 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:39.002850 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:39.061639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aadca8-a648-4653-9d46-e2e36a2dcaa8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:39.064781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8f67-955a-4050-aa26-05b5d81c00dd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:39.099451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:39.100451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:39.100808 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:39.101205 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] PATH_INFO: `/v3/users/b73986d280ca4866abad102bb8e7b247` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:39.103099 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:39.103868 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:39.104231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:39.104588 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] PATH_INFO: `/v3/groups` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:39.106036 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:39.107614 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:39.116705 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] RBAC: Authorizing `identity:get_user(user_id=b73986d280ca4866abad102bb8e7b247)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:39.118320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:39.125320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 157/307] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:38 2022] GET /identity/v3/users/b73986d280ca4866abad102bb8e7b247 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:39.125320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:39.128309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 151/308] 10.222.0.94 () {60 vars in 1134 bytes} [Fri Jul 15 15:30:38 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:39.129202 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:39.218814 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:39.265261 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac367f5-201b-4b6a-9f28-9544ffda31e8 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:39.294382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882915d-1c1d-4516-8128-fa95a1f93cf4 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:39.305448 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:39.314063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27d7f-102d-485c-bd81-73c38a81c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:39.315247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27d7f-102d-485c-bd81-73c38a81c23d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:39.315763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27d7f-102d-485c-bd81-73c38a81c23d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:39.316524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27d7f-102d-485c-bd81-73c38a81c23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:39.317614 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27d7f-102d-485c-bd81-73c38a81c23d None admin] RBAC: Adding query filter params (role.id=61243bfc1a6942c98b2e8f3d6fb716c0, user.id=b73986d280ca4866abad102bb8e7b247, scope.system=all) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:39.318124 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27d7f-102d-485c-bd81-73c38a81c23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:39.320090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27d7f-102d-485c-bd81-73c38a81c23d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:39.327435 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 152/309] 10.222.0.94 () {56 vars in 1308 bytes} [Fri Jul 15 15:30:39 2022] GET /identity/v3/role_assignments?user.id=b73986d280ca4866abad102bb8e7b247&scope.system=all&role.id=61243bfc1a6942c98b2e8f3d6fb716c0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:39.340467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7176be-de03-4671-bfa2-c9896992081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:39.341492 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7176be-de03-4671-bfa2-c9896992081f None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:39.341776 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7176be-de03-4671-bfa2-c9896992081f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:39.342051 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7176be-de03-4671-bfa2-c9896992081f None admin] PATH_INFO: `/v3/system/users/f3ad3e4d33fd4947a32a686272968460/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:39.343689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7176be-de03-4671-bfa2-c9896992081f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f3ad3e4d33fd4947a32a686272968460, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:39.345142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7176be-de03-4671-bfa2-c9896992081f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:39.356292 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 158/310] 10.222.0.94 () {58 vars in 1334 bytes} [Fri Jul 15 15:30:39 2022] PUT /identity/v3/system/users/f3ad3e4d33fd4947a32a686272968460/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:39.758955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc397b4-70f6-4cdd-8f2e-9b1631826348 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:39.759666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc397b4-70f6-4cdd-8f2e-9b1631826348 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:39.762282 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc397b4-70f6-4cdd-8f2e-9b1631826348 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:39.764221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 153/311] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:39.769410 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48a56-5a56-4862-a7e5-84f30209172b None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:39.769722 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48a56-5a56-4862-a7e5-84f30209172b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:39.769992 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48a56-5a56-4862-a7e5-84f30209172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:39.787528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-13b48a56-5a56-4862-a7e5-84f30209172b None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:39.788787 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-13b48a56-5a56-4862-a7e5-84f30209172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:39.864293 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 159/312] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:39.889547 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc397b4-70f6-4cdd-8f2e-9b1631826348 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:40.016139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc397b4-70f6-4cdd-8f2e-9b1631826348 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:40.052384 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:40.053200 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:40.053489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:40.053772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:40.056596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:40.066354 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:40.074326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:40.075216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:40.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 154/313] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:40.082173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48a56-5a56-4862-a7e5-84f30209172b None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:40.197096 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48a56-5a56-4862-a7e5-84f30209172b None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:40.199399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:40.242991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:40.244001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:40.244470 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:40.244964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:40.245937 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:40.246430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:40.248018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:40.256959 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 160/314] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:40.263458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:40.376097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988747-9671-43bc-a239-4317793e7171 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:40.412321 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:40.413200 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:40.413484 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:40.413759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] PATH_INFO: `/v3/users/736439e1099043769b4c5fe3155a99b4` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:40.414968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] RBAC: Authorizing `identity:get_user(user_id=736439e1099043769b4c5fe3155a99b4)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:40.416443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:40.418592 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 155/315] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:40 2022] GET /identity/v3/users/736439e1099043769b4c5fe3155a99b4 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:40.424317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:40.535989 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d6d31-1402-4f93-b886-d1352c52b844 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:40.577145 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:40.578114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:40.578609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:40.579088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:40.611378 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:40.656261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:40.658207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:40.761880 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 161/316] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:40.773090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:40.835769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:40.874671 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9e1b1-db81-4362-8930-9fde4c395679 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:40.911339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c6d88-e4e4-4cf6-b427-735845552f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:40.912153 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c6d88-e4e4-4cf6-b427-735845552f2a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:40.912440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c6d88-e4e4-4cf6-b427-735845552f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:40.912718 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c6d88-e4e4-4cf6-b427-735845552f2a None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:40.913900 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c6d88-e4e4-4cf6-b427-735845552f2a None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:40.915350 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c6d88-e4e4-4cf6-b427-735845552f2a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:40.922042 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 156/317] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:40 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:40.924836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.020953 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:41.052785 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e81fc-87df-47e8-bd36-397f42fdbca1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:41.091980 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70899b5b-5e94-4e73-96b3-34b6a0130522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:41.095757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70899b5b-5e94-4e73-96b3-34b6a0130522 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.095757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70899b5b-5e94-4e73-96b3-34b6a0130522 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.095757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70899b5b-5e94-4e73-96b3-34b6a0130522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.095757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70899b5b-5e94-4e73-96b3-34b6a0130522 None admin] RBAC: Adding query filter params (role.id=61243bfc1a6942c98b2e8f3d6fb716c0, scope.project.id=5bdc3d7568314f38be815c34893be785, user.id=736439e1099043769b4c5fe3155a99b4) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:41.095757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70899b5b-5e94-4e73-96b3-34b6a0130522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:41.096215 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70899b5b-5e94-4e73-96b3-34b6a0130522 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:41.103881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 162/318] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:30:40 2022] GET /identity/v3/role_assignments?user.id=736439e1099043769b4c5fe3155a99b4&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=61243bfc1a6942c98b2e8f3d6fb716c0 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:41.745198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d862bf-edab-492e-9f0d-594826d7d725 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.745774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d862bf-edab-492e-9f0d-594826d7d725 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.745774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d862bf-edab-492e-9f0d-594826d7d725 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.747293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 157/319] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:41.753687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dbc3-3005-4651-b7ed-3e610279f673 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.753984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dbc3-3005-4651-b7ed-3e610279f673 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.754275 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dbc3-3005-4651-b7ed-3e610279f673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.772886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-6ff4dbc3-3005-4651-b7ed-3e610279f673 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:41.774475 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52664-1396-41e1-a1b4-d318b04d984e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.774765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52664-1396-41e1-a1b4-d318b04d984e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.775046 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52664-1396-41e1-a1b4-d318b04d984e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.775205 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-6ff4dbc3-3005-4651-b7ed-3e610279f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:41.776489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 158/320] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:30:41.782794 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7015b5-d537-4ebb-9dac-dcb8932b9b98 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.783235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7015b5-d537-4ebb-9dac-dcb8932b9b98 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.783524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7015b5-d537-4ebb-9dac-dcb8932b9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.804091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-9f7015b5-d537-4ebb-9dac-dcb8932b9b98 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:41.805499 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-9f7015b5-d537-4ebb-9dac-dcb8932b9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:41.853193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 163/321] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:41.869579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba9c13-9cc5-4516-a4d8-f86f9d05f022 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.870060 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba9c13-9cc5-4516-a4d8-f86f9d05f022 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.870355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba9c13-9cc5-4516-a4d8-f86f9d05f022 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.871761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 164/322] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:41.880981 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404e27-50cf-42d4-be79-2ef58b2a75a4 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:41.881279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404e27-50cf-42d4-be79-2ef58b2a75a4 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:41.881563 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71404e27-50cf-42d4-be79-2ef58b2a75a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:41.885447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 159/323] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:41.886720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7015b5-d537-4ebb-9dac-dcb8932b9b98 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:41.906291 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-71404e27-50cf-42d4-be79-2ef58b2a75a4 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:41.907653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-71404e27-50cf-42d4-be79-2ef58b2a75a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:41.956806 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:41.974561 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:41.994240 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 165/324] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:41.995276 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404e27-50cf-42d4-be79-2ef58b2a75a4 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.014560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7015b5-d537-4ebb-9dac-dcb8932b9b98 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.053855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.054673 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.054958 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.055231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.056475 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.057928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.060126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 160/325] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:30:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:42.060896 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.106411 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71404e27-50cf-42d4-be79-2ef58b2a75a4 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.146486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.147292 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.147577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.147884 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.158673 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:42.166544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:42.167459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 166/326] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:42.173290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.175447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5fcc3-6ea3-47af-a9f9-c8a4d4b8407d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.211317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:42.219712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.220542 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.220832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.221110 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.227356 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:42.235128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:42.243717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:42.244799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:42.246339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:42.248453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 161/327] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:42.249605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.290490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558f648-82ae-47fe-9147-ea02d98c1fd9 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.329207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.329885 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.330172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.330450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] PATH_INFO: `/v3/groups` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.331146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.332739 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.348977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 167/328] 10.222.0.94 () {60 vars in 1134 bytes} [Fri Jul 15 15:30:42 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:30:42.349942 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.364661 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305b86-9fe8-4c3c-b672-8c0077a9f9ae None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.415358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.416858 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.417151 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.417991 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.418767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:42.419079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.420722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.431534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 162/329] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:42.441747 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.516906 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:42.526261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ec3c7-44da-4535-9bea-e00e26907b2c None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.537620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:42.580418 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.580679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.582156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.582156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.582945 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:42.582945 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.584334 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.592834 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb873c-baaa-47bd-bd09-0e393a6c09c4 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.600756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 168/330] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:42.602201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.643082 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.643961 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.643961 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.644233 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] PATH_INFO: `/v3/users/f3ad3e4d33fd4947a32a686272968460` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.646279 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] RBAC: Authorizing `identity:get_user(user_id=f3ad3e4d33fd4947a32a686272968460)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.648586 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.650666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 163/331] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:42 2022] GET /identity/v3/users/f3ad3e4d33fd4947a32a686272968460 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:42.657548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.770728 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9553b-6c84-476f-bd54-7ec6b6706b77 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.810428 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4f536-b6be-476f-802d-6ba48f6623eb None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:42.820757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.822235 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.822736 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.823222 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] PATH_INFO: `/v3/users/b73986d280ca4866abad102bb8e7b247` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.824902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] RBAC: Authorizing `identity:get_user(user_id=b73986d280ca4866abad102bb8e7b247)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.826598 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.831190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 169/332] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:42 2022] GET /identity/v3/users/b73986d280ca4866abad102bb8e7b247 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:42.835299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:42.838013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:42.865809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49656a-b887-45a0-9cb1-5c830a37ba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:42.866702 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49656a-b887-45a0-9cb1-5c830a37ba61 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:42.867061 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49656a-b887-45a0-9cb1-5c830a37ba61 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:42.876124 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49656a-b887-45a0-9cb1-5c830a37ba61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:42.877090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49656a-b887-45a0-9cb1-5c830a37ba61 None admin] RBAC: Adding query filter params (role.id=6b04d13512924cf4b057253a13eb63d1, user.id=f3ad3e4d33fd4947a32a686272968460, scope.system=all) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:42.877425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49656a-b887-45a0-9cb1-5c830a37ba61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:42.878911 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49656a-b887-45a0-9cb1-5c830a37ba61 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:42.915278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:42.930090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 164/333] 10.222.0.94 () {56 vars in 1308 bytes} [Fri Jul 15 15:30:42 2022] GET /identity/v3/role_assignments?user.id=f3ad3e4d33fd4947a32a686272968460&scope.system=all&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 510 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:43.005157 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c399f8b-884f-4ef0-af9a-79d5e9aa679c None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:43.051451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f150e-bf0b-4a40-a575-1acb92be9959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:43.052424 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f150e-bf0b-4a40-a575-1acb92be9959 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:43.052731 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f150e-bf0b-4a40-a575-1acb92be9959 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:43.053016 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f150e-bf0b-4a40-a575-1acb92be9959 None admin] PATH_INFO: `/v3/system/users/b73986d280ca4866abad102bb8e7b247/roles/61243bfc1a6942c98b2e8f3d6fb716c0` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:43.054662 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f150e-bf0b-4a40-a575-1acb92be9959 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b73986d280ca4866abad102bb8e7b247, role_id=61243bfc1a6942c98b2e8f3d6fb716c0)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:43.056213 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f150e-bf0b-4a40-a575-1acb92be9959 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:43.066242 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 170/334] 10.222.0.94 () {58 vars in 1334 bytes} [Fri Jul 15 15:30:42 2022] PUT /identity/v3/system/users/b73986d280ca4866abad102bb8e7b247/roles/61243bfc1a6942c98b2e8f3d6fb716c0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:45.947771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc558c-768b-4812-b758-591bf815dbb6 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:45.947771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc558c-768b-4812-b758-591bf815dbb6 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:45.947771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc558c-768b-4812-b758-591bf815dbb6 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:45.948806 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 165/335] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:45.957279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911272-804e-4094-a99a-d042f9ec2581 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:45.957745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911272-804e-4094-a99a-d042f9ec2581 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:45.957940 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911272-804e-4094-a99a-d042f9ec2581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:45.996974 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-45911272-804e-4094-a99a-d042f9ec2581 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:45.998451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-45911272-804e-4094-a99a-d042f9ec2581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:46.035597 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee93e-6c2a-4b59-b78f-108ab243f60f None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.035597 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee93e-6c2a-4b59-b78f-108ab243f60f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.035597 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee93e-6c2a-4b59-b78f-108ab243f60f None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.036511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 166/336] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:46.049507 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada36b-af6e-4b18-9080-42143e1de6cb None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.050181 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada36b-af6e-4b18-9080-42143e1de6cb None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.050658 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeada36b-af6e-4b18-9080-42143e1de6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.088803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-eeada36b-af6e-4b18-9080-42143e1de6cb None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:46.090955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-eeada36b-af6e-4b18-9080-42143e1de6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:46.120937 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 171/337] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:46.125141 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a0bc7-b9dd-42f4-a47b-cf030c74884f None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.125836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a0bc7-b9dd-42f4-a47b-cf030c74884f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.126381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a0bc7-b9dd-42f4-a47b-cf030c74884f None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.127939 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 172/338] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:46.133854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284300-5bbc-4214-a4f6-5bd28c616120 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.134356 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284300-5bbc-4214-a4f6-5bd28c616120 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.134835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b284300-5bbc-4214-a4f6-5bd28c616120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.158213 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-2b284300-5bbc-4214-a4f6-5bd28c616120 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:46.160146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-2b284300-5bbc-4214-a4f6-5bd28c616120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:46.195626 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:46.271791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 173/339] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:46.271791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284300-5bbc-4214-a4f6-5bd28c616120 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.289278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 167/340] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:46.320924 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeada36b-af6e-4b18-9080-42143e1de6cb None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.444907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b284300-5bbc-4214-a4f6-5bd28c616120 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:46.460724 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeada36b-af6e-4b18-9080-42143e1de6cb None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:46.473076 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:46.497197 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:46.497197 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.497197 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.499601 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.508177 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d3beb-7f57-4ea6-977f-4e114df6f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:46.509435 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3beb-7f57-4ea6-977f-4e114df6f8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.509897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3beb-7f57-4ea6-977f-4e114df6f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.510312 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d3beb-7f57-4ea6-977f-4e114df6f8b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.523413 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d3beb-7f57-4ea6-977f-4e114df6f8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:46.526533 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-d12d3beb-7f57-4ea6-977f-4e114df6f8b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:46.534831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:46.535785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 15:30:46.536600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:46.538944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:46.539820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:46.540629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:46.541359 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 174/341] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:46.542149 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.543250 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 168/342] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:46.544853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5667-d298-4c09-825d-1f85f756d460 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.545440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5667-d298-4c09-825d-1f85f756d460 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.545885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e5667-d298-4c09-825d-1f85f756d460 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.547670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 169/343] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:46.548671 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e5667-d298-4c09-825d-1f85f756d460 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.574617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:46.676260 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e5667-d298-4c09-825d-1f85f756d460 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:46.677531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172290-67ad-49e4-8552-4080eb2a04fd None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:46.714645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:46.715811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.716383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.716879 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.717906 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:46.718522 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:46.720445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5981f0-5e56-4c2b-b482-1cf7eea5e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:46.720679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:46.721296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5981f0-5e56-4c2b-b482-1cf7eea5e380 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.721611 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5981f0-5e56-4c2b-b482-1cf7eea5e380 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.721868 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5981f0-5e56-4c2b-b482-1cf7eea5e380 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.732821 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 170/344] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:46.733958 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.737275 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5981f0-5e56-4c2b-b482-1cf7eea5e380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-3e5981f0-5e56-4c2b-b482-1cf7eea5e380 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:46.749234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:46.750143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:46.750931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 175/345] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:46.752304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf463-7e12-42b4-b1aa-41c8d456c3ce None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.752602 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf463-7e12-42b4-b1aa-41c8d456c3ce None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.752888 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf463-7e12-42b4-b1aa-41c8d456c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.773259 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:46.776150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-72caf463-7e12-42b4-b1aa-41c8d456c3ce None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:46.777443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-72caf463-7e12-42b4-b1aa-41c8d456c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:46.854699 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ed77-c90a-45a3-b36e-6aae6830b62d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:46.856881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 176/346] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:46.858464 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf463-7e12-42b4-b1aa-41c8d456c3ce None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.875842 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:46.898489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:46.899597 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:46.900144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:46.900666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:46.901809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:46.902407 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:46.905077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:46.915073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 171/347] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:46.917639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:46.985380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf463-7e12-42b4-b1aa-41c8d456c3ce None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:47.026518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:47.027844 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:47.028847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:47.029760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:47.029760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:47.038638 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517236-5674-402d-9a93-cba71f709830 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:47.080533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:47.081581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:47.082110 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:47.082626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:47.083568 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:47.084129 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:47.085938 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:47.095885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 172/348] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:47.097035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:47.109501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:47.111486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:47.128587 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:47.222386 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c0ec-ef60-4d7e-9281-4ed7bffdefcc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:47.256587 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 177/349] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:47.257716 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:47.268454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:47.269361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:47.269712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:47.270058 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:47.282492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:47.290782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:47.291687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:47.293221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:47.297904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 173/350] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:47.297904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:47.321239 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:47.467196 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee922459-85f6-4c6b-afba-6a32bdce82aa None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:47.486964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:47.527325 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc3eb-5204-4af3-8b62-f0fb56fda736 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:47.532289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:47.532289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:47.532289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:47.532289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] PATH_INFO: `/v3/users/b73986d280ca4866abad102bb8e7b247` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:47.535523 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] RBAC: Authorizing `identity:get_user(user_id=b73986d280ca4866abad102bb8e7b247)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:47.536751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:47.538602 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 178/351] 10.222.0.94 () {56 vars in 1177 bytes} [Fri Jul 15 15:30:47 2022] GET /identity/v3/users/b73986d280ca4866abad102bb8e7b247 => generated 293 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:47.539211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:47.615335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:47.616031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:47.616329 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:47.616615 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:47.679638 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81b55f-73f4-4b34-9c35-3d2551c5ff8c None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:47.713064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:47.714977 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:47.741472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:47.754035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:47.754897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:47.755187 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:47.755477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:47.758935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:47.761380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:47.766863 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 179/352] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:47 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:47.766863 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:47.859864 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:47.886324 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 174/353] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:47.888101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:47.944389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97c410-3260-4a63-b93b-461189f836e1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:47.996149 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb54bb-ece1-44fd-bc37-fb64c98f73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:47.996836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb54bb-ece1-44fd-bc37-fb64c98f73fb None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:47.999119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb54bb-ece1-44fd-bc37-fb64c98f73fb None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:47.999119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb54bb-ece1-44fd-bc37-fb64c98f73fb None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:47.999119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb54bb-ece1-44fd-bc37-fb64c98f73fb None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:47.999119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb54bb-ece1-44fd-bc37-fb64c98f73fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:47.999813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb54bb-ece1-44fd-bc37-fb64c98f73fb None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:48.015121 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 180/354] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:48.017100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473153-ca5a-476e-8674-2cfade9b8326 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.017714 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473153-ca5a-476e-8674-2cfade9b8326 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.017996 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473153-ca5a-476e-8674-2cfade9b8326 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.023211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 181/355] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:48.023211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc473153-ca5a-476e-8674-2cfade9b8326 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:48.066020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48785d-9c23-4159-b965-79fcfce0b235 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:48.092101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:48.123540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:48.125378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.125378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.125378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.125611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] RBAC: Adding query filter params (role.id=61243bfc1a6942c98b2e8f3d6fb716c0, user.id=b73986d280ca4866abad102bb8e7b247, scope.system=all) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:48.125865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:48.127441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:48.145779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 175/356] 10.222.0.94 () {56 vars in 1308 bytes} [Fri Jul 15 15:30:47 2022] GET /identity/v3/role_assignments?user.id=b73986d280ca4866abad102bb8e7b247&scope.system=all&role.id=61243bfc1a6942c98b2e8f3d6fb716c0 => generated 510 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:48.146711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:48.186183 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc473153-ca5a-476e-8674-2cfade9b8326 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:48.203457 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:48.280646 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258bc52-917a-413d-bc7b-28109f0cb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:48.281574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258bc52-917a-413d-bc7b-28109f0cb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.281918 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258bc52-917a-413d-bc7b-28109f0cb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.282206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258bc52-917a-413d-bc7b-28109f0cb3e6 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.299839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258bc52-917a-413d-bc7b-28109f0cb3e6 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:48.299839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258bc52-917a-413d-bc7b-28109f0cb3e6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:48.300093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e753d-1ede-470e-a3e4-84e397a31cdd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:48.301051 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 182/357] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:48 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:48.309524 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2ad5-43cf-41de-9387-5a2d49638e1e None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.310046 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2ad5-43cf-41de-9387-5a2d49638e1e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.310541 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2ad5-43cf-41de-9387-5a2d49638e1e None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.312567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 183/358] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:48.313582 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2ad5-43cf-41de-9387-5a2d49638e1e None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:48.362288 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501245eb-837e-4b7a-9633-375d54207764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:48.363165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501245eb-837e-4b7a-9633-375d54207764 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.363451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501245eb-837e-4b7a-9633-375d54207764 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.363726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501245eb-837e-4b7a-9633-375d54207764 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.367012 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501245eb-837e-4b7a-9633-375d54207764 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:48.371866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501245eb-837e-4b7a-9633-375d54207764 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:48.373693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 176/359] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:48 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:48.375132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285a880-a129-4f41-9e6a-6a0c64f72317 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.376155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285a880-a129-4f41-9e6a-6a0c64f72317 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.376155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285a880-a129-4f41-9e6a-6a0c64f72317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.404695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-c285a880-a129-4f41-9e6a-6a0c64f72317 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:48.405909 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-c285a880-a129-4f41-9e6a-6a0c64f72317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:48.470256 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:48.485692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2ad5-43cf-41de-9387-5a2d49638e1e None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:48.517798 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 177/360] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:48.519336 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285a880-a129-4f41-9e6a-6a0c64f72317 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:48.537034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:48.537754 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.538045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.538383 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.610151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:48.657506 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:48.658841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:48.687059 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285a880-a129-4f41-9e6a-6a0c64f72317 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:48.746335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217497ef-bdf0-45b6-81a1-a1e2df5ab8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:48.746335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217497ef-bdf0-45b6-81a1-a1e2df5ab8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.746335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217497ef-bdf0-45b6-81a1-a1e2df5ab8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.746335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217497ef-bdf0-45b6-81a1-a1e2df5ab8e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.747070 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217497ef-bdf0-45b6-81a1-a1e2df5ab8e1 None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=07eb2ce2492b445686e24aed81fe97c8) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:48.747389 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217497ef-bdf0-45b6-81a1-a1e2df5ab8e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:48.750532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217497ef-bdf0-45b6-81a1-a1e2df5ab8e1 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:48.756809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 178/361] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:30:48 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=62b39839f9fe48649ad91d0114c66534 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:48.758162 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac9b19-73c6-40c3-b75c-30d7fbef3ecf None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:48.759440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac9b19-73c6-40c3-b75c-30d7fbef3ecf None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:48.759440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac9b19-73c6-40c3-b75c-30d7fbef3ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:48.787333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-2eac9b19-73c6-40c3-b75c-30d7fbef3ecf None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:48.789047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-2eac9b19-73c6-40c3-b75c-30d7fbef3ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:48.832367 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 184/362] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:48.834396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:48.844966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:48.915525 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 179/363] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:48.916828 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac9b19-73c6-40c3-b75c-30d7fbef3ecf None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:48.955589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:49.006734 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b61a4-026a-451b-8d35-5f1b0ab51907 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.079616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.080768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.081435 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.081913 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.083341 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:49.085116 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:49.086031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac9b19-73c6-40c3-b75c-30d7fbef3ecf None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.091960 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 185/364] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:48 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:49.093233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.140853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.143488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.143878 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.145167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.157631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:49.168348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:49.169251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:49.170073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:49.173598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 180/365] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:49.173598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.206813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:49.232238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73ad69-7e6c-40c7-a49b-d022a10c980f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.275495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.276783 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.277289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.277777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.279227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:49.280912 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:49.283613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 186/366] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:49.284805 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.302505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:49.323935 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a4bf5-d555-45d8-b41c-c221f38fe652 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.376165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.376165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.376585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.376767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.392178 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:49.400310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:49.401543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:49.402524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:49.403239 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 181/367] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:49.403806 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.453806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979fee9-1df3-4d49-81d7-1ff1c7fd8a9d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.517229 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.517899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.518188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.518463 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.519295 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=07eb2ce2492b445686e24aed81fe97c8) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:49.519610 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:49.521065 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:49.531273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 187/368] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:49.533073 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.553425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:49.581882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e76946-61fd-4116-bfc5-9fe904d4df1c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.648241 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:49.655011 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.656151 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.656696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.657174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.658300 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:49.658815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:49.661596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:49.684372 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 182/369] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:49.685281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.698020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6596d2-07e7-49f4-9276-d331539ce7ed None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.759213 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.760296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.760616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.761739 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.762971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:49.764452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:49.766458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 188/370] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:49.789547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.850267 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915c25-bf47-4935-ae04-207e2e410116 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:49.916407 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:49.917712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:49.917998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:49.918275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:49.919034 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:49.919344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:49.920776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:49.944995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 183/371] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:49.946179 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:49.968955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:49.981316 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264238f-0fe7-4cb5-893d-5066eda1db41 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:50.047837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:50.049546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:50.049835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:50.050114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:50.074034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:50.143301 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:50.145435 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:50.239726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58128f-13ed-412a-a9ed-bd195c8f365a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:50.264702 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 189/372] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:50.265565 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:50.292728 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:50.293411 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:50.299817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:50.299817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:50.299817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=5bdc3d7568314f38be815c34893be785) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:50.299817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:50.299817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:50.309663 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 184/373] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:30:49 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 260 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:50.311771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:50.337973 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:50.406623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:50.463425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb216f0d-b8e4-4a8a-9d14-cb702f23c1d6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:50.500991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbe0c7-a179-4ddb-b8e4-11ad101358e5 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:50.542441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:50.543628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:50.544232 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:50.544653 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:50.547374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:50.550649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:50.554126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 185/374] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:50 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:50.565080 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:50.585083 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:50.586105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:50.586564 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:50.587010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:50.727319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:50.729100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:50.744052 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345026b-092c-4f62-b643-cf62836e52d6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:50.818065 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:50.820776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:50.821347 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:50.822235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:50.824195 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:50.828672 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:50.830426 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:50.833818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 186/375] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:50 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:50.845073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:50.883009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:50.962708 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 190/376] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:50.974278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:51.039720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e4138-c81b-4e37-8fb8-3ce9389f7fd9 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:51.095864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:51.095864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:51.095864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:51.095864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:51.096287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=5bdc3d7568314f38be815c34893be785) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:51.096287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:51.096287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:51.111199 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 187/377] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:30:50 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=62b39839f9fe48649ad91d0114c66534 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:51.208458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93af14-1030-4cf4-8ef5-f67dd6234d69 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:51.281002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db10658-7cca-4a06-a2fe-5d0031d6cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:51.281230 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db10658-7cca-4a06-a2fe-5d0031d6cd59 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:51.281457 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db10658-7cca-4a06-a2fe-5d0031d6cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:51.281741 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db10658-7cca-4a06-a2fe-5d0031d6cd59 None admin] PATH_INFO: `/v3/projects/0448cce79e4a43eab947a52177358b0b` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:51.295766 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db10658-7cca-4a06-a2fe-5d0031d6cd59 None admin] RBAC: Authorizing `identity:get_project(project_id=0448cce79e4a43eab947a52177358b0b)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:51.295766 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db10658-7cca-4a06-a2fe-5d0031d6cd59 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:51.295766 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 191/378] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:50 2022] GET /identity/v3/projects/0448cce79e4a43eab947a52177358b0b => generated 344 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:51.300948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:51.378656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78ca5-5313-48fd-96cf-853595e6a530 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:51.378930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78ca5-5313-48fd-96cf-853595e6a530 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:51.379153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b78ca5-5313-48fd-96cf-853595e6a530 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:51.393209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 192/379] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:51 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:51.399559 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3840b46-2504-4eda-9c31-4a02ee764aa5 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:51.399874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3840b46-2504-4eda-9c31-4a02ee764aa5 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:51.400159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3840b46-2504-4eda-9c31-4a02ee764aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:51.427702 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:51.457045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e3840b46-2504-4eda-9c31-4a02ee764aa5 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:51.458057 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e3840b46-2504-4eda-9c31-4a02ee764aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:51.461399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:51.477963 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9998-1eb5-4cc0-b388-baf0c346d676 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:51.533865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:51.536897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:51.537184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:51.537462 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] PATH_INFO: `/v3/groups/17c1f62c22b14654b99d3c92cf931e1c` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:51.550870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] RBAC: Authorizing `identity:get_group(group_id=17c1f62c22b14654b99d3c92cf931e1c)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:51.554901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:51.558368 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 188/380] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:51 2022] GET /identity/v3/groups/17c1f62c22b14654b99d3c92cf931e1c => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:51.566180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:51.637800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 193/381] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:51.687768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3840b46-2504-4eda-9c31-4a02ee764aa5 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:51.730772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e951-a7bb-4ae4-9ad7-2001b1c7e714 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:51.793213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:51.793885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:51.794172 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:51.794552 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:51.795493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] RBAC: Adding query filter params (group.id=17c1f62c22b14654b99d3c92cf931e1c, role.id=8442e7332b934407beff8c3564575b62, scope.project.id=0448cce79e4a43eab947a52177358b0b) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:51.795829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:51.797274 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:51.810358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:51.823522 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 189/382] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:30:51 2022] GET /identity/v3/role_assignments?group.id=17c1f62c22b14654b99d3c92cf931e1c&scope.project.id=0448cce79e4a43eab947a52177358b0b&role.id=8442e7332b934407beff8c3564575b62 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:51.866692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3840b46-2504-4eda-9c31-4a02ee764aa5 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:51.904719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:51.905488 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:51.905775 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:51.906049 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:51.915706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:51.919907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:51.929372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:51.930308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:51.931081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 194/383] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:30:51.937343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:52.091309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ccc76-1075-4157-bcaf-873a5457eb2f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:52.144966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde686ef-bd2f-42fd-b301-6da02f7e9976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:52.146073 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde686ef-bd2f-42fd-b301-6da02f7e9976 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:52.146552 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde686ef-bd2f-42fd-b301-6da02f7e9976 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:52.147020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde686ef-bd2f-42fd-b301-6da02f7e9976 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:52.147987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde686ef-bd2f-42fd-b301-6da02f7e9976 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:52.148505 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde686ef-bd2f-42fd-b301-6da02f7e9976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:52.150103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde686ef-bd2f-42fd-b301-6da02f7e9976 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:52.169965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 190/384] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:52.176849 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:52.311269 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21935-a2fd-41a5-a3e7-92ef6ea1f12e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:52.312294 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21935-a2fd-41a5-a3e7-92ef6ea1f12e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:52.312878 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21935-a2fd-41a5-a3e7-92ef6ea1f12e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:52.314633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 191/385] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:52.330925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ebf75-bf86-41d1-bb17-3c25e1254501 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:52.331253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ebf75-bf86-41d1-bb17-3c25e1254501 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:52.331541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ebf75-bf86-41d1-bb17-3c25e1254501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:52.374802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-b30ebf75-bf86-41d1-bb17-3c25e1254501 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:52.380764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-b30ebf75-bf86-41d1-bb17-3c25e1254501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:52.437887 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb379c-1c2b-4c63-8708-e08909d011bb None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:52.494080 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:52.515363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 192/386] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:52.517400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:52.518309 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:52.518594 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:52.518867 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:52.520199 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:52.521746 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:52.523659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 195/387] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:52 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:52.530941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ebf75-bf86-41d1-bb17-3c25e1254501 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:52.551706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:52.650915 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:52.693528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e3564-7698-461c-9f88-3dbf9d9f6157 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:52.748803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:52.749639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:52.749925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:52.750204 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:52.775683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:52.798682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:52.799597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:52.800751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 196/388] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:30:52.806473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:52.902275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ebf75-bf86-41d1-bb17-3c25e1254501 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:52.956586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77a31e-1b28-4c08-8a0d-497d5e367169 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:52.987337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:53.014828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.015871 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.016413 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.016828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.017903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:53.018351 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:53.019881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:53.045121 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 197/389] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:53.050730 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:53.080489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.081383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.087801 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.087801 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.088541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:53.090672 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:53.092629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 193/390] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:52 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:53.104833 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:53.249869 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:53.271664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8fc1e-06a6-487d-913c-d58c38bb0bac None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:53.339176 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0e817-46d7-4199-a341-c584365c39f9 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:53.361195 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.362067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.362365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.362650 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.371941 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:53.373469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:53.375502 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 198/391] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:53 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:53.382055 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:53.390126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be517cb-5231-47a7-8b0b-31db9aef7b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.391228 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be517cb-5231-47a7-8b0b-31db9aef7b2e None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.391844 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be517cb-5231-47a7-8b0b-31db9aef7b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.392251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be517cb-5231-47a7-8b0b-31db9aef7b2e None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8/groups/503663b0e5b748d28231378d5a470a04/roles/62b39839f9fe48649ad91d0114c66534` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.399478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be517cb-5231-47a7-8b0b-31db9aef7b2e None admin] RBAC: Authorizing `identity:create_grant(project_id=07eb2ce2492b445686e24aed81fe97c8, group_id=503663b0e5b748d28231378d5a470a04, role_id=62b39839f9fe48649ad91d0114c66534)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:53.401633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be517cb-5231-47a7-8b0b-31db9aef7b2e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:53.426761 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 194/392] 10.222.0.94 () {58 vars in 1442 bytes} [Fri Jul 15 15:30:53 2022] PUT /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8/groups/503663b0e5b748d28231378d5a470a04/roles/62b39839f9fe48649ad91d0114c66534 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:53.429755 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722dd1a-93db-48ef-8422-16fde8f1f8c4 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.429755 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722dd1a-93db-48ef-8422-16fde8f1f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.429755 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722dd1a-93db-48ef-8422-16fde8f1f8c4 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.435343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 195/393] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:53.438731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dade6ae-8aa6-4bb0-84d1-1d5d7709e128 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.439013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dade6ae-8aa6-4bb0-84d1-1d5d7709e128 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.440192 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dade6ae-8aa6-4bb0-84d1-1d5d7709e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.481027 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-9dade6ae-8aa6-4bb0-84d1-1d5d7709e128 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:53.482593 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-9dade6ae-8aa6-4bb0-84d1-1d5d7709e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:53.550853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:53.635517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158795-f34b-43bf-8980-605d2d36bf69 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:53.674092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 196/394] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:53.696787 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.698584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:53.699118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:53.699605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:53.701074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:53.702743 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:53.706945 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 199/395] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:53 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:53.708535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dade6ae-8aa6-4bb0-84d1-1d5d7709e128 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:53.713160 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:53.812210 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:53.914975 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dade6ae-8aa6-4bb0-84d1-1d5d7709e128 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:53.940415 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634f458-73a5-4717-9526-60c73c8f2bb1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:53.997756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:53.999032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.001029 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.001570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:54.001710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] PATH_INFO: `/v3/roles/member` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.021190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b15256-fda3-4404-8ad2-3fa29265a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:54.022249 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b15256-fda3-4404-8ad2-3fa29265a59b None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.022543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b15256-fda3-4404-8ad2-3fa29265a59b None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.022825 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b15256-fda3-4404-8ad2-3fa29265a59b None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8/groups/503663b0e5b748d28231378d5a470a04/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.027580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b15256-fda3-4404-8ad2-3fa29265a59b None admin] RBAC: Authorizing `identity:create_grant(project_id=07eb2ce2492b445686e24aed81fe97c8, group_id=503663b0e5b748d28231378d5a470a04, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:54.029076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b15256-fda3-4404-8ad2-3fa29265a59b None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:54.034541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:54.044921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:54.045880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:54.046668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:54.052013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 197/396] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:54.056867 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:54.070755 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 200/397] 10.222.0.94 () {58 vars in 1442 bytes} [Fri Jul 15 15:30:53 2022] PUT /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8/groups/503663b0e5b748d28231378d5a470a04/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:54.229457 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43955a-807f-4a4d-9090-863e3b0141db None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.230203 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43955a-807f-4a4d-9090-863e3b0141db None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.230687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43955a-807f-4a4d-9090-863e3b0141db None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.236978 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 201/398] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:54.239125 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619523c-abb3-4b63-b009-4ebde03e8c7d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.239652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619523c-abb3-4b63-b009-4ebde03e8c7d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.240172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619523c-abb3-4b63-b009-4ebde03e8c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.266187 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e619523c-abb3-4b63-b009-4ebde03e8c7d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:54.267914 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e619523c-abb3-4b63-b009-4ebde03e8c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:54.310636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdc36-9b8f-4cf3-882c-d9317965beed None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:54.334724 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:54.383759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:54.386510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.387003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.387552 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.388565 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:54.390258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:54.392182 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:54.415822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 198/399] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:54.419407 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:54.451860 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 202/400] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:54.484699 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619523c-abb3-4b63-b009-4ebde03e8c7d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:54.622075 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868b988-9e2a-4c95-80ac-b730023c18c0 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:54.664483 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81738008-5e86-416a-9921-082bde475ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:54.665702 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738008-5e86-416a-9921-082bde475ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.666184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738008-5e86-416a-9921-082bde475ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.667352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738008-5e86-416a-9921-082bde475ce2 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.679759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81738008-5e86-416a-9921-082bde475ce2 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:54.679759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81738008-5e86-416a-9921-082bde475ce2 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:54.684594 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 199/401] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:54 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:54.685124 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798021-8eae-4316-9768-ed4135820c2b None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.691052 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798021-8eae-4316-9768-ed4135820c2b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.692900 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798021-8eae-4316-9768-ed4135820c2b None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.692900 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 200/402] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:54.706322 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6798021-8eae-4316-9768-ed4135820c2b None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:54.752805 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619523c-abb3-4b63-b009-4ebde03e8c7d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:54.776074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:54.806510 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75885b-8666-44e4-aefd-fdab363693cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:54.808639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75885b-8666-44e4-aefd-fdab363693cb None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.811379 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75885b-8666-44e4-aefd-fdab363693cb None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.811677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75885b-8666-44e4-aefd-fdab363693cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.821975 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:54.835194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75885b-8666-44e4-aefd-fdab363693cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-de75885b-8666-44e4-aefd-fdab363693cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:54.851562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:54.852517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:54.853302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:54.858067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 203/403] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:54.860597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571c7b-4e05-4b3c-9bfc-dc8c4ceebea3 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:54.861095 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571c7b-4e05-4b3c-9bfc-dc8c4ceebea3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:54.861588 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571c7b-4e05-4b3c-9bfc-dc8c4ceebea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:54.903518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-ca571c7b-4e05-4b3c-9bfc-dc8c4ceebea3 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:54.905034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-ca571c7b-4e05-4b3c-9bfc-dc8c4ceebea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:55.029596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 204/404] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:55.030433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571c7b-4e05-4b3c-9bfc-dc8c4ceebea3 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:55.032426 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6798021-8eae-4316-9768-ed4135820c2b None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:55.088834 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:55.089709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:55.089997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:55.090283 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:55.092767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:55.095657 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:55.103617 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 201/405] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:54 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:55.104573 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:55.265744 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571c7b-4e05-4b3c-9bfc-dc8c4ceebea3 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:55.274751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:55.327480 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccafe71-c8d9-4072-9aa6-9e086257efc7 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:55.343375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:55.344374 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:55.344898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:55.345387 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:55.346326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:55.346835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:55.348449 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:55.351832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:55.374903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 205/406] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:55.376132 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:55.410543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:55.412112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:55.413398 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:55.414051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:55.437436 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:55.451654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:55.452716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:30:55.453506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:55.464553 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 202/407] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:55.465789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:55.596120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd600ffb-9541-4814-9a49-929e1a573cbc None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:55.705884 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:55.708983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:55.710257 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:55.712124 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785/groups/503663b0e5b748d28231378d5a470a04/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:55.718328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdc3d7568314f38be815c34893be785, group_id=503663b0e5b748d28231378d5a470a04, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:55.721206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:55.722942 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622046e-7020-4d41-9e64-68379c5dec08 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:55.775777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 206/408] 10.222.0.94 () {58 vars in 1442 bytes} [Fri Jul 15 15:30:55 2022] PUT /identity/v3/projects/5bdc3d7568314f38be815c34893be785/groups/503663b0e5b748d28231378d5a470a04/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:55.775777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:55.831654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:55.833128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:55.833478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:55.833767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:55.836372 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:55.838186 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:55.843227 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 203/409] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:55 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:55.859546 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:55.862174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:56.003572 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:56.131060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d055e3-9648-4a8c-b992-f21c52a4ded5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:56.181712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e4ee4-944c-4455-bec6-54cff94647b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:56.183296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e4ee4-944c-4455-bec6-54cff94647b3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.183581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e4ee4-944c-4455-bec6-54cff94647b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.183966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e4ee4-944c-4455-bec6-54cff94647b3 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.185789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e4ee4-944c-4455-bec6-54cff94647b3 None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:56.187340 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af3436-ddea-4b2c-82c5-3fc1d4223305 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:56.187519 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e4ee4-944c-4455-bec6-54cff94647b3 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:56.190568 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 204/410] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:55 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:56.195183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1581e-0138-4e98-8fd2-8c4cd6b9d669 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.195183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1581e-0138-4e98-8fd2-8c4cd6b9d669 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.195183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1581e-0138-4e98-8fd2-8c4cd6b9d669 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.195183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 205/411] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:56.200521 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1581e-0138-4e98-8fd2-8c4cd6b9d669 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:56.305428 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb913a-2a8b-47b3-9892-f339e5380aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:56.307603 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb913a-2a8b-47b3-9892-f339e5380aa6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.309420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb913a-2a8b-47b3-9892-f339e5380aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.309903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb913a-2a8b-47b3-9892-f339e5380aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.312623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb913a-2a8b-47b3-9892-f339e5380aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:56.312623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb913a-2a8b-47b3-9892-f339e5380aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:56.318123 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb913a-2a8b-47b3-9892-f339e5380aa6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:56.347301 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 207/412] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:56.350708 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d06a2-49fd-40b7-ba83-e055ddc1ee8e None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.351595 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d06a2-49fd-40b7-ba83-e055ddc1ee8e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.352489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d06a2-49fd-40b7-ba83-e055ddc1ee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.411284 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-b34d06a2-49fd-40b7-ba83-e055ddc1ee8e None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:56.415358 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-b34d06a2-49fd-40b7-ba83-e055ddc1ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:56.461696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1581e-0138-4e98-8fd2-8c4cd6b9d669 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:56.464601 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:56.502697 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:56.504035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.504540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.505021 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785/groups/503663b0e5b748d28231378d5a470a04/roles/62b39839f9fe48649ad91d0114c66534` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.507869 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bdc3d7568314f38be815c34893be785, group_id=503663b0e5b748d28231378d5a470a04, role_id=62b39839f9fe48649ad91d0114c66534)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:56.509568 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:56.531841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 208/414] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:56.531841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d06a2-49fd-40b7-ba83-e055ddc1ee8e None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:56.532337 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 206/414] 10.222.0.94 () {58 vars in 1442 bytes} [Fri Jul 15 15:30:56 2022] PUT /identity/v3/projects/5bdc3d7568314f38be815c34893be785/groups/503663b0e5b748d28231378d5a470a04/roles/62b39839f9fe48649ad91d0114c66534 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:56.558269 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:56.561305 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:56.655023 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d06a2-49fd-40b7-ba83-e055ddc1ee8e None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:56.694899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1b9e3-b44e-42ba-8f4b-aa285f0bc28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:56.695751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b9e3-b44e-42ba-8f4b-aa285f0bc28e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.696053 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b9e3-b44e-42ba-8f4b-aa285f0bc28e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.696338 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1b9e3-b44e-42ba-8f4b-aa285f0bc28e None admin] PATH_INFO: `/v3/groups/17c1f62c22b14654b99d3c92cf931e1c` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.697647 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b9e3-b44e-42ba-8f4b-aa285f0bc28e None admin] RBAC: Authorizing `identity:get_group(group_id=17c1f62c22b14654b99d3c92cf931e1c)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:56.699221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1b9e3-b44e-42ba-8f4b-aa285f0bc28e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:56.705816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 209/415] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:56 2022] GET /identity/v3/groups/17c1f62c22b14654b99d3c92cf931e1c => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:56.707972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f12a-4ee2-4787-9eb3-f5192ed9948f None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.708273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f12a-4ee2-4787-9eb3-f5192ed9948f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.708611 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f12a-4ee2-4787-9eb3-f5192ed9948f None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.710546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 210/416] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:56.711471 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f12a-4ee2-4787-9eb3-f5192ed9948f None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:56.754387 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a365be4-d0e6-4d28-89eb-cb04e941d702 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:56.799601 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db95516-fc27-4064-803c-ab01052116a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:56.801315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95516-fc27-4064-803c-ab01052116a2 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.801315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95516-fc27-4064-803c-ab01052116a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.802525 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95516-fc27-4064-803c-ab01052116a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.814042 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:56.815147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db95516-fc27-4064-803c-ab01052116a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-7db95516-fc27-4064-803c-ab01052116a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:56.824234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:56.825292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:56.826270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 207/417] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:56.827149 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bece90-28ab-49ad-8cf3-d988fdad0a40 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.827449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bece90-28ab-49ad-8cf3-d988fdad0a40 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.827760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bece90-28ab-49ad-8cf3-d988fdad0a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.836296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f12a-4ee2-4787-9eb3-f5192ed9948f None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:56.847780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-68bece90-28ab-49ad-8cf3-d988fdad0a40 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:56.849347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-68bece90-28ab-49ad-8cf3-d988fdad0a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:56.869007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:56.889238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:56.890142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:56.890433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:56.890713 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] PATH_INFO: `/v3/projects/0448cce79e4a43eab947a52177358b0b` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:56.892330 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] RBAC: Authorizing `identity:get_project(project_id=0448cce79e4a43eab947a52177358b0b)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:56.894670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:56.896729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 211/418] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:56 2022] GET /identity/v3/projects/0448cce79e4a43eab947a52177358b0b => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:56.897605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:56.928884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 208/419] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:30:56.935756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bece90-28ab-49ad-8cf3-d988fdad0a40 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:57.038417 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cca25-de94-4765-9163-8809b0976e21 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:57.063015 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bece90-28ab-49ad-8cf3-d988fdad0a40 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:57.086638 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:57.087484 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:57.088054 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:57.088605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:57.089706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:57.090135 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:57.093502 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:57.101965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 212/420] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:57.107115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:57.111540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:57.112663 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:57.113092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:57.113542 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] PATH_INFO: `/v3/projects/0448cce79e4a43eab947a52177358b0b/groups/17c1f62c22b14654b99d3c92cf931e1c/roles/8442e7332b934407beff8c3564575b62` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:57.116315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] RBAC: Authorizing `identity:create_grant(project_id=0448cce79e4a43eab947a52177358b0b, group_id=17c1f62c22b14654b99d3c92cf931e1c, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:57.118812 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:57.131916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:57.142422 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 209/421] 10.222.0.94 () {58 vars in 1442 bytes} [Fri Jul 15 15:30:56 2022] PUT /identity/v3/projects/0448cce79e4a43eab947a52177358b0b/groups/17c1f62c22b14654b99d3c92cf931e1c/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:30:57.144443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:57.164794 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:57.254743 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3003423-4026-441e-8d6d-f2cc6404f3af None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:57.294423 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52e9da-9ff9-4f77-adcb-b43df86f2939 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:57.327335 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:57.328207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:57.328499 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:57.328786 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:57.358364 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:57.376574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:57.377616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:57.378420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:57.379081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 213/422] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:57.383232 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:57.384208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:57.384636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:57.385132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:57.390216 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:57.464942 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:57.467254 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:57.488611 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:57.504270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:57.550445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9131d-ed93-4b90-87ac-430ea73434f1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:57.594055 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 210/423] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:57.600808 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:57.641772 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:57.642817 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:57.643320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:57.643828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:57.644770 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] RBAC: Adding query filter params (name=member) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:57.645271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:57.648330 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:57.673560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 214/424] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:57.675454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:57.808767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686b81c-e21f-4238-a16c-abf0e167f63e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:57.841024 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:57.873327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:57.875220 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:57.875612 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:57.878001 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:57.878001 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:57.880759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:57.886181 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a6052-be66-4b35-96e1-7c5c537bf905 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:57.889624 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 211/425] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:57 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:57.891529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:57.946426 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:57.947384 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:57.947848 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:57.948233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:57.983761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:58.038688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:58.044071 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:58.152087 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 215/426] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:58.157443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:58.221488 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:58.264148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec90c51-a1eb-4c85-a359-3ed442bf9e78 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:58.290887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408d59d-5606-4653-858e-7b9647b35375 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:58.324043 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:58.324921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.325204 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.325481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] PATH_INFO: `/v3/projects/07eb2ce2492b445686e24aed81fe97c8` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.327897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] RBAC: Authorizing `identity:get_project(project_id=07eb2ce2492b445686e24aed81fe97c8)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:58.329398 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:58.331100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 216/427] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:58 2022] GET /identity/v3/projects/07eb2ce2492b445686e24aed81fe97c8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:58.337957 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:58.365673 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:58.366549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.366832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.367109 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.369477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:58.372117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:58.373865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 212/428] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:57 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:58.380451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:58.453421 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:58.499601 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4b8c9-2ccc-4374-a125-a62d08868e48 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:58.520729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ba41-2794-40c8-9135-dc149ba02a6a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:58.536197 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:58.536867 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.537155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.537434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.538292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=07eb2ce2492b445686e24aed81fe97c8) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:58.538579 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:58.540077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:58.546945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 213/429] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:30:58 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=62b39839f9fe48649ad91d0114c66534 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:58.552395 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:58.579179 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f93424-d109-4bf7-a0bb-528ce59afcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:58.580170 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93424-d109-4bf7-a0bb-528ce59afcd6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.580454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93424-d109-4bf7-a0bb-528ce59afcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.580729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93424-d109-4bf7-a0bb-528ce59afcd6 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.582035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f93424-d109-4bf7-a0bb-528ce59afcd6 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:58.583489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f93424-d109-4bf7-a0bb-528ce59afcd6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:58.585496 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 217/430] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:58 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:58.591861 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:58.681335 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833d09-5d93-4d24-92be-c04005c0c79a None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.681669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833d09-5d93-4d24-92be-c04005c0c79a None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.682530 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833d09-5d93-4d24-92be-c04005c0c79a None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.688372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 218/431] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:58.694535 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49b5c-2bbd-469a-8081-aa20e8e5c0db None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.694854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49b5c-2bbd-469a-8081-aa20e8e5c0db None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.695093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49b5c-2bbd-469a-8081-aa20e8e5c0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.713390 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8ac49b5c-2bbd-469a-8081-aa20e8e5c0db None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:58.714512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8ac49b5c-2bbd-469a-8081-aa20e8e5c0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:58.717296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d9123-7ee2-4d03-acfa-2194aa2551dc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:58.744771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:58.784249 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:58.784977 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.785268 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.785608 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.786455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=07eb2ce2492b445686e24aed81fe97c8) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:58.786773 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:58.788062 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 219/432] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:58.792368 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:58.802142 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 214/433] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:30:58 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=07eb2ce2492b445686e24aed81fe97c8&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:58.812684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49b5c-2bbd-469a-8081-aa20e8e5c0db None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:58.929702 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49b5c-2bbd-469a-8081-aa20e8e5c0db None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:58.938913 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:58.974261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:58.974558 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:58.974711 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:58.975913 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:58.986828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:58.994760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:58.996881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:30:58.998836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 220/434] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:30:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:59.003789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:59.121291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d942d-06b4-4150-ab10-cb951928b415 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:59.158780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfa406-b185-4c48-a83c-0f7f04e85b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:59.159881 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfa406-b185-4c48-a83c-0f7f04e85b9d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.160399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfa406-b185-4c48-a83c-0f7f04e85b9d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.160894 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfa406-b185-4c48-a83c-0f7f04e85b9d None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.161847 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfa406-b185-4c48-a83c-0f7f04e85b9d None admin] RBAC: Adding query filter params (name=member) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:59.162359 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfa406-b185-4c48-a83c-0f7f04e85b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:59.163995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfa406-b185-4c48-a83c-0f7f04e85b9d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:59.174018 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 215/435] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:30:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:30:59.179458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:59.297914 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b41f2-8744-4181-94b6-b77c57cdda18 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:59.334604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:59.335616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.336130 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.336637 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.353557 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924dc1-22b7-4e79-9da3-f7bc62855a52 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.354226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924dc1-22b7-4e79-9da3-f7bc62855a52 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.354712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924dc1-22b7-4e79-9da3-f7bc62855a52 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.359492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 216/436] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:59.365205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a36b-fc2b-4a5e-8ad4-b12e220aa028 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.365802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a36b-fc2b-4a5e-8ad4-b12e220aa028 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.366285 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220a36b-fc2b-4a5e-8ad4-b12e220aa028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.390187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-4220a36b-fc2b-4a5e-8ad4-b12e220aa028 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:59.391401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-4220a36b-fc2b-4a5e-8ad4-b12e220aa028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:59.392876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.437459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:59.439417 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:59.442124 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.487240 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 217/437] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:30:59.513830 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a36b-fc2b-4a5e-8ad4-b12e220aa028 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:59.576460 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 221/438] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:30:59.582931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:59.630749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220a36b-fc2b-4a5e-8ad4-b12e220aa028 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:59.658526 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.668556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:59.669379 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.669662 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.669936 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.681438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:30:59.690097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:30:59.690997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:30:59.691841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 218/439] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:30:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:30:59.696995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:59.705611 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a426b6-4e9b-42d2-985a-533bb530b839 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:59.730413 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.754641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:59.755841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.756131 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.756809 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.758550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:59.760231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:59.762823 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 222/440] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:30:59 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:59.768180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:59.811234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a507a-139b-497e-b6ce-b9b813a9bbef None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:59.844850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d536ca-df87-44b6-8ec6-917d3855328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:59.845435 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d536ca-df87-44b6-8ec6-917d3855328b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.845722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d536ca-df87-44b6-8ec6-917d3855328b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.846003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d536ca-df87-44b6-8ec6-917d3855328b None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.846744 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d536ca-df87-44b6-8ec6-917d3855328b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:30:59.847054 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d536ca-df87-44b6-8ec6-917d3855328b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:59.848451 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d536ca-df87-44b6-8ec6-917d3855328b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:59.857309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 219/441] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:30:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:59.858531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920b9c-8b13-4c70-9da7-e6f5f84f1d5b None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.858825 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920b9c-8b13-4c70-9da7-e6f5f84f1d5b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.859110 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88920b9c-8b13-4c70-9da7-e6f5f84f1d5b None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.860657 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 220/442] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:30:59.863025 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88920b9c-8b13-4c70-9da7-e6f5f84f1d5b None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:30:59.871540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd21f2-521a-49ab-b700-9891e40e856f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:30:59.906917 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d275f-c45e-444d-87e7-19d24dca4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:30:59.907831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d275f-c45e-444d-87e7-19d24dca4f81 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.908119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d275f-c45e-444d-87e7-19d24dca4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.908405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d275f-c45e-444d-87e7-19d24dca4f81 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.909586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d275f-c45e-444d-87e7-19d24dca4f81 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:30:59.911017 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d275f-c45e-444d-87e7-19d24dca4f81 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:30:59.912681 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 223/443] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:30:59 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:30:59.913818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314145cc-1888-4c52-a3d6-111e2956db75 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:30:59.914108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314145cc-1888-4c52-a3d6-111e2956db75 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:30:59.914390 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314145cc-1888-4c52-a3d6-111e2956db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:30:59.919585 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.932938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-314145cc-1888-4c52-a3d6-111e2956db75 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:30:59.934130 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-314145cc-1888-4c52-a3d6-111e2956db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:30:59.959611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:30:59.969877 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88920b9c-8b13-4c70-9da7-e6f5f84f1d5b None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.004173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 224/444] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:00.004929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314145cc-1888-4c52-a3d6-111e2956db75 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.005114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.005740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.006032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.006316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.080178 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:00.081624 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:00.108314 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314145cc-1888-4c52-a3d6-111e2956db75 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.138076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:00.143630 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.144326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.144614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.144895 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.145844 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=6b04d13512924cf4b057253a13eb63d1, scope.project.id=5bdc3d7568314f38be815c34893be785) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:00.146165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:00.147746 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:00.154105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 225/445] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=6b04d13512924cf4b057253a13eb63d1 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:00.154926 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.185408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:00.197257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 221/446] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 15:31:00.203275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.279293 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca6ae6-fb33-4de6-a45a-d79d85dd1b1e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.313349 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dbc30-4905-4eef-a822-54ba82f31d88 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.317858 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.318683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.318975 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.319259 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.332623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:00.340396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:00.341354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:00.342155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 226/447] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:00.347430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.354313 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.355175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.355459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.355762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] PATH_INFO: `/v3/projects/5bdc3d7568314f38be815c34893be785` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.356987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] RBAC: Authorizing `identity:get_project(project_id=5bdc3d7568314f38be815c34893be785)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:00.358532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:00.360734 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 222/448] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/projects/5bdc3d7568314f38be815c34893be785 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:00.366272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.416528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:00.438641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:00.474712 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaf60-75d2-4007-8c3c-cb194489a3d9 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.489495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a75b6-61cc-4a4d-8d7f-ae973d3f38ca None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.517227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.517907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.518191 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.518467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.519211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:00.519523 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:00.520937 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:00.531490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 227/449] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:00.534888 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.535828 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.536120 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.536405 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] PATH_INFO: `/v3/groups/503663b0e5b748d28231378d5a470a04` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.537512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.537634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] RBAC: Authorizing `identity:get_group(group_id=503663b0e5b748d28231378d5a470a04)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:00.539085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:00.543051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 223/450] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/groups/503663b0e5b748d28231378d5a470a04 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:00.549037 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.640937 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99113729-a55c-4663-92d0-30f3e768e13f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.650594 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d8d5-1f48-4d07-a1dd-d4ad05f99854 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:00.657592 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:00.675219 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.675901 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.676187 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.676465 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.677956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:00.686832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:00.687488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:00.687896 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:00.688191 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:00.689024 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] RBAC: Adding query filter params (group.id=503663b0e5b748d28231378d5a470a04, role.id=62b39839f9fe48649ad91d0114c66534, scope.project.id=5bdc3d7568314f38be815c34893be785) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:00.689341 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:00.690786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:00.696613 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 224/451] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/role_assignments?group.id=503663b0e5b748d28231378d5a470a04&scope.project.id=5bdc3d7568314f38be815c34893be785&role.id=62b39839f9fe48649ad91d0114c66534 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:00.749520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:00.751008 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:00.856029 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 228/452] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:00.861958 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:00.967156 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc48270-708b-442b-9c00-b25a6f50b9fa None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:01.003198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:01.004101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:01.004384 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:01.004661 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] PATH_INFO: `/v3/projects/0448cce79e4a43eab947a52177358b0b` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:01.005844 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] RBAC: Authorizing `identity:get_project(project_id=0448cce79e4a43eab947a52177358b0b)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:01.007544 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:01.009265 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 225/453] 10.222.0.94 () {56 vars in 1186 bytes} [Fri Jul 15 15:31:00 2022] GET /identity/v3/projects/0448cce79e4a43eab947a52177358b0b => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:01.014935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:01.034798 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:01.118777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa65172-72e0-49e3-a9cc-1c8124a9f83d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:01.153830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39f603-a581-4115-bab2-45956cd5e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:01.154678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f603-a581-4115-bab2-45956cd5e46c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:01.154962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f603-a581-4115-bab2-45956cd5e46c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:01.155246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f603-a581-4115-bab2-45956cd5e46c None admin] PATH_INFO: `/v3/groups/17c1f62c22b14654b99d3c92cf931e1c` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:01.156443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39f603-a581-4115-bab2-45956cd5e46c None admin] RBAC: Authorizing `identity:get_group(group_id=17c1f62c22b14654b99d3c92cf931e1c)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:01.157993 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39f603-a581-4115-bab2-45956cd5e46c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:01.159603 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 229/454] 10.222.0.94 () {56 vars in 1180 bytes} [Fri Jul 15 15:31:01 2022] GET /identity/v3/groups/17c1f62c22b14654b99d3c92cf931e1c => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:01.165526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:01.223550 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:01.263167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e79e6-3313-48c7-a122-d0cee1f0f71e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:01.295536 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377863d-9be8-4a99-a71b-5a5c54b0c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:01.296204 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377863d-9be8-4a99-a71b-5a5c54b0c34b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:01.296491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377863d-9be8-4a99-a71b-5a5c54b0c34b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:01.296769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377863d-9be8-4a99-a71b-5a5c54b0c34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:01.297587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377863d-9be8-4a99-a71b-5a5c54b0c34b None admin] RBAC: Adding query filter params (group.id=17c1f62c22b14654b99d3c92cf931e1c, role.id=8442e7332b934407beff8c3564575b62, scope.project.id=0448cce79e4a43eab947a52177358b0b) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:01.297898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377863d-9be8-4a99-a71b-5a5c54b0c34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:01.299318 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377863d-9be8-4a99-a71b-5a5c54b0c34b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:01.305091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 226/455] 10.222.0.94 () {56 vars in 1376 bytes} [Fri Jul 15 15:31:01 2022] GET /identity/v3/role_assignments?group.id=17c1f62c22b14654b99d3c92cf931e1c&scope.project.id=0448cce79e4a43eab947a52177358b0b&role.id=8442e7332b934407beff8c3564575b62 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:03.820211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b63b9-367c-42b6-95ae-7b26b5304e9d None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:03.820763 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b63b9-367c-42b6-95ae-7b26b5304e9d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:03.820763 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b63b9-367c-42b6-95ae-7b26b5304e9d None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:03.823088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 230/456] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:03.828803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d953135-f43f-4c30-bab5-af8afb89e8ff None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:03.829799 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d953135-f43f-4c30-bab5-af8afb89e8ff None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:03.830316 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d953135-f43f-4c30-bab5-af8afb89e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:03.848969 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-2d953135-f43f-4c30-bab5-af8afb89e8ff None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:03.850546 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-2d953135-f43f-4c30-bab5-af8afb89e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:03.928461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 227/457] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:03.954042 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b63b9-367c-42b6-95ae-7b26b5304e9d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.010159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d1fa-2af4-4b4f-b2ff-68ac45ac56db None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.010786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d1fa-2af4-4b4f-b2ff-68ac45ac56db None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.011270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d1fa-2af4-4b4f-b2ff-68ac45ac56db None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.013237 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 228/458] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:04.019349 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c513a-49e3-47a2-b0f3-bb183e46b9e5 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.019952 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c513a-49e3-47a2-b0f3-bb183e46b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.020470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c513a-49e3-47a2-b0f3-bb183e46b9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.037908 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-a57c513a-49e3-47a2-b0f3-bb183e46b9e5 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:04.039410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-a57c513a-49e3-47a2-b0f3-bb183e46b9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:04.070393 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.088792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b63b9-367c-42b6-95ae-7b26b5304e9d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.102602 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.124947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 229/459] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:31:04.126723 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d136d-2cdd-4ec1-9cbc-8c8bcbf41cbc None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.127241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d136d-2cdd-4ec1-9cbc-8c8bcbf41cbc None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.127710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d136d-2cdd-4ec1-9cbc-8c8bcbf41cbc None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.129458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 230/460] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:04.134570 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c9719-36ef-4e77-bd96-0cdd69e87fd8 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.134871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c9719-36ef-4e77-bd96-0cdd69e87fd8 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.135156 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c9719-36ef-4e77-bd96-0cdd69e87fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.141775 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.142583 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.142878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.143157 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.153060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-576c9719-36ef-4e77-bd96-0cdd69e87fd8 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:04.154266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-576c9719-36ef-4e77-bd96-0cdd69e87fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:04.160828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.162276 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:04.181911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:04.182803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:04.183652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:04.183652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:04.183652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:04.183652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:04.183652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 231/461] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:04.183975 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.235820 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 231/462] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:04.236790 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c9719-36ef-4e77-bd96-0cdd69e87fd8 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.305775 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902737dd-f3e9-4edd-90b3-dbe57fdb634e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.345171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.345978 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c9719-36ef-4e77-bd96-0cdd69e87fd8 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.346232 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.346515 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.346789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.355117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.359694 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.361476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.362093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.382163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.382830 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.383116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.383393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:04.383692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:04.385159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:04.386058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:04.386058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:04.386058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:04.386058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:04.386275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:04.386275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.386393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.390719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 232/463] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:04.391385 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.403822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 232/464] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:04.403822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.499026 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ed9d4-83af-4d38-b575-ef2cf35e7dee None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.512988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb978371-a9b1-4cab-807b-8cb8c62a2fff None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.533178 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1126c-ab22-4a81-a9ad-51e94919a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.533970 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1126c-ab22-4a81-a9ad-51e94919a896 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.534265 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1126c-ab22-4a81-a9ad-51e94919a896 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.534545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1126c-ab22-4a81-a9ad-51e94919a896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.545561 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.546218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1126c-ab22-4a81-a9ad-51e94919a896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.546333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.546503 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.546781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.547495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:04.547685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1126c-ab22-4a81-a9ad-51e94919a896 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.547818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.549178 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.561280 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 233/465] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:04.562051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-0ec1126c-ab22-4a81-a9ad-51e94919a896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:04.567577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:04.568579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:04.569405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:04.569405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:04.569405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:04.569405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:04.569405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 233/466] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:04.570682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e2008-b329-44d4-be00-e30672482bad None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.570682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e2008-b329-44d4-be00-e30672482bad None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.570879 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e2008-b329-44d4-be00-e30672482bad None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.575831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 234/467] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:04.575831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e2008-b329-44d4-be00-e30672482bad None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.600196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.619385 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.667387 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d053d-baaf-4a4c-aded-b8ce4b66b769 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.678910 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e2008-b329-44d4-be00-e30672482bad None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.700749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.701422 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.701709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.701986 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.702683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.704168 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.711945 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4ea55-58c8-4ec2-8874-b23402c9b43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.713112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ea55-58c8-4ec2-8874-b23402c9b43a None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.713394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ea55-58c8-4ec2-8874-b23402c9b43a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.713669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ea55-58c8-4ec2-8874-b23402c9b43a None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.714586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4ea55-58c8-4ec2-8874-b23402c9b43a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.715867 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4ea55-58c8-4ec2-8874-b23402c9b43a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.725081 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 234/468] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:31:04 2022] POST /identity/v3/users => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:04.725886 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.747537 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 235/469] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:31:04 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:04.749360 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739714e-bfcd-487c-81f2-4ec5bb713b3d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.749660 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739714e-bfcd-487c-81f2-4ec5bb713b3d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.749962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739714e-bfcd-487c-81f2-4ec5bb713b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.776469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8739714e-bfcd-487c-81f2-4ec5bb713b3d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:04.777871 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8739714e-bfcd-487c-81f2-4ec5bb713b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:04.876069 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.891924 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 236/470] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:04.892452 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee7e9-2e23-4974-8f68-e98a33fcefae None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:04.917531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739714e-bfcd-487c-81f2-4ec5bb713b3d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:04.936253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:04.936924 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:04.937214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:04.937641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:04.938383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:04.938695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:04.940118 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:04.956167 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:04.959157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 235/471] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:04.964345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:05.055294 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739714e-bfcd-487c-81f2-4ec5bb713b3d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:05.088341 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d879c0-bdd0-4043-9860-66e9be112773 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:05.103848 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:05.105159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:05.105749 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:05.106031 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:05.120460 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:05.122794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:05.125902 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:05.126648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:05.126881 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:05.127260 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:05.128048 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:05.129488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:05.146088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:05.147010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:05.148227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:05.148227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:05.148227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:05.148227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:05.148227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 237/472] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:05.154353 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:05.159934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 236/473] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:31:04 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:31:05.263846 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:05.277204 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def42c-e628-4275-8cca-3cf880ce0be2 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:05.317604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b6dd2-f5ba-4924-a306-83f6d61c5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:05.318334 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b6dd2-f5ba-4924-a306-83f6d61c5a61 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:05.318625 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b6dd2-f5ba-4924-a306-83f6d61c5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:05.319184 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b6dd2-f5ba-4924-a306-83f6d61c5a61 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:05.320003 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b6dd2-f5ba-4924-a306-83f6d61c5a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:05.320311 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b6dd2-f5ba-4924-a306-83f6d61c5a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:05.321699 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b6dd2-f5ba-4924-a306-83f6d61c5a61 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:05.342760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 238/474] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:05.349385 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:05.365444 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:05.470913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f8d5f-2623-4667-937f-dd3b4592433f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:05.507171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e81f75-7f38-46da-99bb-ec71c2d3169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:05.507973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81f75-7f38-46da-99bb-ec71c2d3169c None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:05.508265 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81f75-7f38-46da-99bb-ec71c2d3169c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:05.508548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81f75-7f38-46da-99bb-ec71c2d3169c None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:05.509321 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e81f75-7f38-46da-99bb-ec71c2d3169c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:05.511507 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e81f75-7f38-46da-99bb-ec71c2d3169c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:05.535925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 237/475] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:31:05 2022] POST /identity/v3/users => generated 249 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:07.126710 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74564cfd-2945-489d-ae0f-9e5e62c96436 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.127245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74564cfd-2945-489d-ae0f-9e5e62c96436 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.127336 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74564cfd-2945-489d-ae0f-9e5e62c96436 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.128950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 239/476] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:07.135067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde685ec-179d-45a7-8e4d-8a72bd19cd61 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.136242 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde685ec-179d-45a7-8e4d-8a72bd19cd61 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.136742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde685ec-179d-45a7-8e4d-8a72bd19cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.143426 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2cd15-6d4b-460d-963f-2bd36d55c479 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.143716 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2cd15-6d4b-460d-963f-2bd36d55c479 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.144048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2cd15-6d4b-460d-963f-2bd36d55c479 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.145657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 240/477] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:07.150678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6de3e-1ed1-407c-b13a-f913dadbab00 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.150967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6de3e-1ed1-407c-b13a-f913dadbab00 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.151472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6de3e-1ed1-407c-b13a-f913dadbab00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.156103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-cde685ec-179d-45a7-8e4d-8a72bd19cd61 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:07.157541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-cde685ec-179d-45a7-8e4d-8a72bd19cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:07.169319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-90f6de3e-1ed1-407c-b13a-f913dadbab00 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:07.170694 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-90f6de3e-1ed1-407c-b13a-f913dadbab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:07.224196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:07.236614 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 238/478] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:07.249550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 241/479] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:31:07.266736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde685ec-179d-45a7-8e4d-8a72bd19cd61 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.274480 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6de3e-1ed1-407c-b13a-f913dadbab00 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.358719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:07.383097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde685ec-179d-45a7-8e4d-8a72bd19cd61 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:07.404289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6de3e-1ed1-407c-b13a-f913dadbab00 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:07.429241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:07.430524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.431053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.431560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.444411 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:07.452412 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:07.453220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.453504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.453782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:07.454347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:07.455201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:07.456383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:07.463855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 239/480] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:07.466801 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:07.470484 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:07.474946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:07.476651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:07.478285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 242/481] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:07.482104 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.539012 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:07.594837 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348676b-9616-4745-b09e-e482fcc26f87 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:07.610456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ef369-5526-4a87-8227-04fa16043af0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:07.632468 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f75f10-554a-4bf1-945e-a63507a1730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:07.633187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f75f10-554a-4bf1-945e-a63507a1730e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.633503 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f75f10-554a-4bf1-945e-a63507a1730e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.633791 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f75f10-554a-4bf1-945e-a63507a1730e None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.635240 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f75f10-554a-4bf1-945e-a63507a1730e None admin] RBAC: Adding query filter params (name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:07.635551 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f75f10-554a-4bf1-945e-a63507a1730e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:07.636970 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f75f10-554a-4bf1-945e-a63507a1730e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:07.644093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:07.646755 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 240/482] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:07.648052 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03126be8-9415-463b-95c0-5ceb8574d775 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.648344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03126be8-9415-463b-95c0-5ceb8574d775 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.648625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03126be8-9415-463b-95c0-5ceb8574d775 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.653919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 241/483] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:07.654523 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03126be8-9415-463b-95c0-5ceb8574d775 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.654617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a1dc5-6587-401f-a07b-5ce79af49ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:07.655208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a1dc5-6587-401f-a07b-5ce79af49ed8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.655499 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a1dc5-6587-401f-a07b-5ce79af49ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.655806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a1dc5-6587-401f-a07b-5ce79af49ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.656560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a1dc5-6587-401f-a07b-5ce79af49ed8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:07.656874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a1dc5-6587-401f-a07b-5ce79af49ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:07.658270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a1dc5-6587-401f-a07b-5ce79af49ed8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:07.666714 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 243/484] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:07.667947 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933778a6-d416-4826-be26-82a733f72218 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.668249 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933778a6-d416-4826-be26-82a733f72218 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.668532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933778a6-d416-4826-be26-82a733f72218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.686066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-933778a6-d416-4826-be26-82a733f72218 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:07.687355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-933778a6-d416-4826-be26-82a733f72218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:07.771770 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 244/485] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:07.771770 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933778a6-d416-4826-be26-82a733f72218 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.785860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03126be8-9415-463b-95c0-5ceb8574d775 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:07.802421 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:07.825401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:07.826193 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.826475 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.826747 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.837580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:07.839196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:07.857277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:07.858144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:07.858990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:07.858990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:07.858990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:07.858990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:07.858990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 242/486] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:07.859248 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.885027 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933778a6-d416-4826-be26-82a733f72218 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:07.909905 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:07.923421 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:07.924336 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:07.924620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:07.924899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:07.935474 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:07.936955 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:07.954509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:07.955513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:07.957604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:07.957604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:07.957604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:07.957604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:07.957604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 245/487] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:07.957604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:07.970022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746c61-67e7-431e-b596-ea5ca7976264 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.005853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a116c-6c76-4d46-af00-d815cccd3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.006891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a116c-6c76-4d46-af00-d815cccd3313 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.007179 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a116c-6c76-4d46-af00-d815cccd3313 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.007501 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a116c-6c76-4d46-af00-d815cccd3313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.017734 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a116c-6c76-4d46-af00-d815cccd3313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-ed0a116c-6c76-4d46-af00-d815cccd3313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:08.025520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:08.026425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:08.027231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 243/488] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:08.028459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cc0e5-9d71-48ab-9900-00bb6419cd10 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.028459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cc0e5-9d71-48ab-9900-00bb6419cd10 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.028618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cc0e5-9d71-48ab-9900-00bb6419cd10 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.031879 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 244/489] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:08.032659 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cc0e5-9d71-48ab-9900-00bb6419cd10 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.060627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.061696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c7e9-ffa1-4733-9f31-bafefe95d2e0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.095257 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.095949 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.096242 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.096522 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.097249 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:08.097562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.098932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.110540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 246/490] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:08.111347 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.138362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cc0e5-9d71-48ab-9900-00bb6419cd10 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.146304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.171880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca01657-b844-45d3-86d5-240dd00e878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.172541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca01657-b844-45d3-86d5-240dd00e878c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.172824 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca01657-b844-45d3-86d5-240dd00e878c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.173105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca01657-b844-45d3-86d5-240dd00e878c None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.173890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca01657-b844-45d3-86d5-240dd00e878c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:08.174195 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca01657-b844-45d3-86d5-240dd00e878c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.175575 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca01657-b844-45d3-86d5-240dd00e878c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.186915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 245/491] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:08.188126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228711-9631-4ab9-9810-e5f3f9496086 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.188419 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228711-9631-4ab9-9810-e5f3f9496086 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.188688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228711-9631-4ab9-9810-e5f3f9496086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.204529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-5a228711-9631-4ab9-9810-e5f3f9496086 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:08.205714 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-5a228711-9631-4ab9-9810-e5f3f9496086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:08.217194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fcc3-cdc5-43a8-8092-0a17addd60e9 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.249818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.250665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.250925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.251210 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.251988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:08.252404 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.253731 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.265955 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 247/492] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:08.266594 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.277149 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 246/493] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:08.278131 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a228711-9631-4ab9-9810-e5f3f9496086 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.303173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.362558 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.369732 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4230d0-1106-4e37-a02d-67f6208c85bb None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.389020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a228711-9631-4ab9-9810-e5f3f9496086 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.403610 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.404423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.404705 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.404982 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.412339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.413786 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.421729 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.422511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.422794 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.423068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:08.429052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:08.429935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:08.430813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:08.432393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.432466 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 248/494] 10.222.0.94 () {56 vars in 1093 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:08.432529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.432592 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:08.451829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:08.452759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:31:08.453640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:08.456006 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 247/495] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:08.456754 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.533673 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a970d-86f4-41ca-a27f-39212850b548 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.535064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.558548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d45af-9518-44c9-949f-b0bc8a32a146 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.567538 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.568359 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.568642 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.568921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.579312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.580800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.593538 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.594317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.594599 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.594871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:08.598619 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:08.599407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:08.600533 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:08.600533 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:08.600533 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:08.600533 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:08.600533 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 249/496] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:08.600799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.608762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:08.612205 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:08.616631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:08.617531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 248/497] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:08.623209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.702157 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056c959-0fd2-409d-b271-abd3ce3079e7 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.718753 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3d44-20ab-44ff-8ba5-24d4d0c8f5b3 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.735472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.736168 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.736460 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.736741 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.737578 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:08.737898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.739334 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.752223 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.752886 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.753174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.753449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.754319 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:08.754630 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.756344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.767820 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.776270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 250/498] 10.222.0.94 () {56 vars in 1133 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:08.777112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.800163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 249/499] 10.222.0.94 () {56 vars in 1137 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:08.800163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.843400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:08.880004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879d06-53ec-49a1-acd4-4b68af228080 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.898357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601f779-dd08-408a-ba66-ad616769b545 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:08.914360 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.915018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.915300 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.915614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.916356 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:08.916662 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.918024 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.929266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 251/500] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:08.930057 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:08.936308 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:08.936982 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:08.937297 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:08.937584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:08.938328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] RBAC: Adding query filter params (name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:08.938637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:08.940067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:08.949049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 250/501] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:08.949838 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.004187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.041231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff34828-3336-4131-a25d-06a2e4cc47d8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.048361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce2c87-4e13-46e9-8dd9-997a8afc46fb None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.067155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.076726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.077378 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.077664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.077931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.083548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.084225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.084515 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.084792 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.145510 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.146911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.151493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.152974 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.207598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.244512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 252/502] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:09.245353 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.253889 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 251/503] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:09.254731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.274274 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.345711 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b52d20-68b5-4ba5-9dcb-2f90e430e036 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.352433 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8c74e-e02c-4c8c-98b6-74e1fe0ea942 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.379204 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.380092 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.380381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.380654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.386487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.387266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.387559 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.387862 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.388545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.389988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.398003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.399455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:09.404545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:09.405401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:09.406271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 253/504] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:09.406812 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:09.422147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:09.423010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:09.423876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:09.423876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:09.423876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:09.423876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:09.423876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 252/505] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:09.424147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.439566 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.494243 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.509843 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66becc-b97c-49a5-8cd4-3407df6250df None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.532459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfdd84-fb1f-42c1-897a-83022788e584 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.543214 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.544034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.544327 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.544609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.554998 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.557133 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.566346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.567129 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.567417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.567696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:09.575373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:09.576252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:09.577101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:09.577101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:09.577101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:09.577101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:09.577775 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 254/506] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:09.578748 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.578849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.580300 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:09.597853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:09.598864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:09.599760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:09.599760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:09.599760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:09.599760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:09.599760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 253/507] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:09.600043 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.660228 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.683130 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542df25-c5ef-4e69-b0dc-0b931448bb12 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.701130 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeec86-58a9-4862-a591-35572fbee842 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.716674 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.717429 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.717731 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.718013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.718936 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:09.719252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.720736 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.728945 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.734550 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.735297 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.735656 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.736031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.736755 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:09.737069 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.738437 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.740476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 255/508] 10.222.0.94 () {56 vars in 1137 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:09.741279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.759905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 254/509] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:09.759905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.841306 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ffc9-a551-4df5-9a79-804e7dcba10e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.855161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282087a3-77ad-4d10-b668-94274c6bede6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:09.875460 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.876244 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.876533 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.876835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.876943 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.877543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:09.877857 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.879445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.891367 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 256/510] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:09.892197 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.897075 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:09.897738 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:09.898027 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:09.898307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:09.899047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:09.899343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:09.901301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:09.912740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 255/511] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:09.913490 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:09.952645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:09.999056 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ac9ca-4fe0-4198-8884-2d63d35c04e0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.016336 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d891b0-183d-475a-a759-4384e9cf57c2 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.035718 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.036400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.036697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.036965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.051836 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.052628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.052913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.053191 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.061085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.062524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:10.076707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:10.077649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:10.078511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 256/512] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:10.079057 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.106019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.107471 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.119923 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.161963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.179800 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f79ffb-e35b-402f-8825-1f1c44104d46 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.207058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 257/513] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:10.207923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.217517 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.218650 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.218939 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.219528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.226155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.227603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:10.243327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:10.244780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:10.245636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 257/514] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:10.246377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.304311 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26b033-15e7-44eb-99d7-d55da556caba None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.338429 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.339210 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.339497 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.339796 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.344585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.346835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.347543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebd2b-8672-4f84-9982-27a51cad6aef None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.348312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:10.362968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:10.363836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:10.364656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 258/515] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:10.365106 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.384380 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.385049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.385340 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.385623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.386458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:10.386773 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.387323 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.388292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.405765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 258/516] 10.222.0.94 () {56 vars in 1139 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:10.406578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.475100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b312-5af7-4187-94d1-29da83226412 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.506036 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de3701-1858-4637-953b-006b480237e0 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.508372 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.509689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.509973 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.510255 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.521946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.523394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.540589 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:10.540922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:10.541907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:10.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:10.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:10.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:10.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:10.542976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.542976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.542976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.543153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 259/517] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:10.543219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:10.543219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.543333 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.544305 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.564810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 259/518] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:10.565682 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.585324 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.608570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.642137 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdd6b-fc1e-4260-8d49-326d7dcf736c None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.667613 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b47c64-fdd4-4ca9-8adf-951418b9d3c6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.676203 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.676862 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.677144 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.677422 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.678233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:10.678558 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.680013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.698109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 260/519] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:10.698898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.702592 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.703148 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.703431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.703714 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.770225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.771699 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.789050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.795387 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6170c-fa4f-402f-bf20-f4906f2c9e59 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.822579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:10.831256 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.831950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.832237 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.832514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.833231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:10.833542 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.834896 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.846717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 261/520] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:10.847513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.874545 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 260/521] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:10.875677 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:10.950470 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697219-8b72-4621-b150-87caeb3e3c8a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.977065 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ce2b-ccf6-43ab-94dd-ba15b30eb165 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:10.989992 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:10.990658 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:10.990950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:10.991233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:10.992099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=1cebf7555312469984252513f450b58f) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:10.992521 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:10.994556 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:10.995359 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:11.000160 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 262/522] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/role_assignments?user.id=1cebf7555312469984252513f450b58f&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:11.000959 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.013459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.014135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.014424 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.014700 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.015783 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=4c96f27d72744e5fb22cbe798a0cb98e) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:11.016107 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.017618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.024220 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 261/523] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:10 2022] GET /identity/v3/role_assignments?user.id=4c96f27d72744e5fb22cbe798a0cb98e&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:11.024968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.090468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:11.156538 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb47ad-62d2-49ce-9068-02adf6262f74 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:11.182832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c246cba-fc99-464f-8318-caa336cbea1a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:11.200318 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.201722 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.202198 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.202622 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.211431 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.213279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:11.230094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:11.231009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:11.231897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 263/524] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:11.233956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.235012 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.235464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.235945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.238369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.249803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.251270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:11.273427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:11.274481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:11.275922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:11.275922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:11.275922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:11.275922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:11.278389 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 262/525] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:11.283341 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.327725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:11.368228 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613e4da-81bf-47b3-9f65-24fd038f0d7e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:11.385402 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:11.409701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.410837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.411317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.411847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.413038 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:11.413639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.415854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.417059 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e91619-5e99-4204-a6b9-133482fd535b None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:11.429038 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 264/526] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:11.434714 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.456836 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.457561 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.457846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.458125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.458856 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:11.459164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.461135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.480910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 263/527] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:11.487786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.570965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76390305-74f4-4faf-a381-0b5f1ce62778 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:11.588609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:11.595174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53661-c116-42a3-b591-e9ce284ccbef None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:11.615882 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.616559 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.616839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.617122 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.617958 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=5904a25265304dc683441c3b110bd1b3) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:11.618907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.620929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.629284 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 265/528] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/role_assignments?user.id=5904a25265304dc683441c3b110bd1b3&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:11.643491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.644686 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.645155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.645612 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.654363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.656461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:11.673580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:11.674478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:11.675347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:11.677559 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 264/529] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:11.684429 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.724616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:11.804493 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12ce3f-bba3-4304-b83f-9d17a5fc352d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:11.839669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435b12c-7c63-4e11-a361-519783b2c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:11.840443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435b12c-7c63-4e11-a361-519783b2c133 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:11.840824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435b12c-7c63-4e11-a361-519783b2c133 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:11.841201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435b12c-7c63-4e11-a361-519783b2c133 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:11.842087 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435b12c-7c63-4e11-a361-519783b2c133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:11.842495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435b12c-7c63-4e11-a361-519783b2c133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:11.844056 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435b12c-7c63-4e11-a361-519783b2c133 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:11.857009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 266/530] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:11.863055 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:11.975381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1aee3-1229-4465-9419-e1d9e2c1e5b3 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:12.013725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4ea6a-378a-4442-95b2-ac5463dbe626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:12.014623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ea6a-378a-4442-95b2-ac5463dbe626 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:12.015212 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ea6a-378a-4442-95b2-ac5463dbe626 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:12.015638 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ea6a-378a-4442-95b2-ac5463dbe626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:12.016675 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4ea6a-378a-4442-95b2-ac5463dbe626 None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=8a31482a8d184d81a5569d11fcc53181) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:12.017135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4ea6a-378a-4442-95b2-ac5463dbe626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:12.018804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4ea6a-378a-4442-95b2-ac5463dbe626 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:12.025715 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 265/531] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:11 2022] GET /identity/v3/role_assignments?user.id=8a31482a8d184d81a5569d11fcc53181&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:13.326266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b88d2-0890-44ea-8eff-f524f2d0ea97 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.326888 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b88d2-0890-44ea-8eff-f524f2d0ea97 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.326888 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b88d2-0890-44ea-8eff-f524f2d0ea97 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.328508 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 267/532] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:13.333949 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa098-9e0f-440b-8687-600067272c83 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.334389 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa098-9e0f-440b-8687-600067272c83 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.334580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa098-9e0f-440b-8687-600067272c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.352267 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-62daa098-9e0f-440b-8687-600067272c83 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:13.354351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-62daa098-9e0f-440b-8687-600067272c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:13.368593 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:13.429920 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 266/533] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:13.435708 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a533-8d8b-4a5c-bfdc-97510e1c57fb None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.436022 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a533-8d8b-4a5c-bfdc-97510e1c57fb None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.436297 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46a533-8d8b-4a5c-bfdc-97510e1c57fb None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.439807 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 268/534] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:13.443179 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba58d6-d437-460e-978f-dbbb89024bcc None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.443720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba58d6-d437-460e-978f-dbbb89024bcc None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.444247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba58d6-d437-460e-978f-dbbb89024bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.457540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a533-8d8b-4a5c-bfdc-97510e1c57fb None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:13.463578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-c9ba58d6-d437-460e-978f-dbbb89024bcc None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:13.465105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-c9ba58d6-d437-460e-978f-dbbb89024bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:13.551775 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 267/535] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:13.570061 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba58d6-d437-460e-978f-dbbb89024bcc None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:13.570750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:13.579777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46a533-8d8b-4a5c-bfdc-97510e1c57fb None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:13.620556 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:13.621754 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.622342 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.622825 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.636677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:13.645573 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:13.646501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:13.647320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:13.650802 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 269/536] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:13.657111 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:13.670875 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:13.699651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba58d6-d437-460e-978f-dbbb89024bcc None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:13.740405 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:13.741599 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.742076 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.742723 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.757499 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:13.766782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:13.767762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:13.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:13.775853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 268/537] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:13.777905 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:13.780791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7a665-5281-4f46-bbb1-cdc8015f4e15 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:13.816472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:13.817319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.817720 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.818096 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.819638 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:13.819638 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:13.820804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:13.834366 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 270/538] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:13.835485 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:13.856186 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:13.896730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532892-17cb-4993-823f-827d3b729a13 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:13.933530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc897cde-bdbe-481e-8a9f-27069a960d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:13.934215 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897cde-bdbe-481e-8a9f-27069a960d07 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.934483 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897cde-bdbe-481e-8a9f-27069a960d07 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.934762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc897cde-bdbe-481e-8a9f-27069a960d07 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.935508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc897cde-bdbe-481e-8a9f-27069a960d07 None admin] RBAC: Adding query filter params (name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:13.935860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc897cde-bdbe-481e-8a9f-27069a960d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:13.937422 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc897cde-bdbe-481e-8a9f-27069a960d07 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:13.943305 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:13.943491 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cffb-233c-4445-8068-58b5e2b554a3 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:13.952105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 269/539] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:13.953439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51889-32a5-4993-aa96-486424a20756 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.953733 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51889-32a5-4993-aa96-486424a20756 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.954017 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa51889-32a5-4993-aa96-486424a20756 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:13.955289 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 270/540] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:13.959615 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa51889-32a5-4993-aa96-486424a20756 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:13.992138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbd69-4436-4ba6-acd3-3c28309e855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:13.992938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbd69-4436-4ba6-acd3-3c28309e855c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:13.993222 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbd69-4436-4ba6-acd3-3c28309e855c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:13.993496 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbd69-4436-4ba6-acd3-3c28309e855c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.005350 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbd69-4436-4ba6-acd3-3c28309e855c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.007072 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbd69-4436-4ba6-acd3-3c28309e855c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-d08bbd69-4436-4ba6-acd3-3c28309e855c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:14.030468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:14.031567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:14.032468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:14.032468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:14.032468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:14.032468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:14.032468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 271/541] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:14.032900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47c4a7-09e1-4ed1-a058-c245d060211c None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.033187 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47c4a7-09e1-4ed1-a058-c245d060211c None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.033461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47c4a7-09e1-4ed1-a058-c245d060211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.049986 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-0b47c4a7-09e1-4ed1-a058-c245d060211c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:14.051848 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-0b47c4a7-09e1-4ed1-a058-c245d060211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:14.084076 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa51889-32a5-4993-aa96-486424a20756 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.114929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:14.121380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 272/542] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:14.121960 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.122785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.122912 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47c4a7-09e1-4ed1-a058-c245d060211c None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.123066 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.123345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.145290 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.146713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:14.166607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:14.167514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:14.168374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:14.168374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:14.168374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:14.168374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:14.168374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 271/543] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:14.168983 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.232473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:14.256742 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47c4a7-09e1-4ed1-a058-c245d060211c None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.286815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e969c04-1f01-4509-80b3-b4b89293886f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.293915 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.294578 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.294860 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.295137 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.295880 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:14.296278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.297637 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.309501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 273/544] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:14.310312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.322715 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327a1b9-0cd1-473e-a11f-48019a7a418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.323513 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327a1b9-0cd1-473e-a11f-48019a7a418f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.323831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327a1b9-0cd1-473e-a11f-48019a7a418f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.324120 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327a1b9-0cd1-473e-a11f-48019a7a418f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.334178 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327a1b9-0cd1-473e-a11f-48019a7a418f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-2327a1b9-0cd1-473e-a11f-48019a7a418f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:14.342049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:14.343014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:14.343887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 272/545] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:14.344563 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a73a79-0cdc-4b8a-9e8f-67473f73f341 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.345203 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a73a79-0cdc-4b8a-9e8f-67473f73f341 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.345203 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a73a79-0cdc-4b8a-9e8f-67473f73f341 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.346358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 273/546] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:14.346924 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a73a79-0cdc-4b8a-9e8f-67473f73f341 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.376782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:14.419363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fefba7-3f7e-4408-8976-652b28b7d8fe None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.452494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a73a79-0cdc-4b8a-9e8f-67473f73f341 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.453488 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.454159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.454455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.454741 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.455452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:14.455853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.457165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.464981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:14.469490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 274/547] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:14.470301 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.490836 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8937a4-16a1-4a0d-a65c-7e9cee3252a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.491621 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8937a4-16a1-4a0d-a65c-7e9cee3252a1 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.491940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8937a4-16a1-4a0d-a65c-7e9cee3252a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.492218 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8937a4-16a1-4a0d-a65c-7e9cee3252a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.500304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8937a4-16a1-4a0d-a65c-7e9cee3252a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.501764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8937a4-16a1-4a0d-a65c-7e9cee3252a1 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-ac8937a4-16a1-4a0d-a65c-7e9cee3252a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:14.517846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:14.518919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:14.519835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 274/548] 10.222.0.94 () {56 vars in 1093 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:14.520412 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b236-d70c-420a-9f46-c6509f6554b1 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.520486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b236-d70c-420a-9f46-c6509f6554b1 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.520758 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b236-d70c-420a-9f46-c6509f6554b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.536792 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-d690b236-d70c-420a-9f46-c6509f6554b1 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:14.537999 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-d690b236-d70c-420a-9f46-c6509f6554b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:14.577997 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959fa9-04be-4174-ace0-90f67ed2f400 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.598410 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:14.604520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 275/549] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:14.606114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b236-d70c-420a-9f46-c6509f6554b1 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.614703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.615444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.615830 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.616125 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.617155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:14.617467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.619725 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.627822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 275/550] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:14.628525 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.720377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b236-d70c-420a-9f46-c6509f6554b1 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.721876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:14.729066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a7c2-b165-44cd-91f4-ccf3d2efd5b4 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.755150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.756239 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.756523 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.756804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.762368 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.763023 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.763313 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.763594 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.763856 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.764453 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:14.764768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.765356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.766276 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:14.779772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:14.780766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 276/551] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:14.782581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.792454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 276/552] 10.222.0.94 () {56 vars in 1133 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:14.792454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.831515 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:14.883254 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82a76-ef3b-4dc4-8461-104b069fa026 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.889754 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283bc20-0563-4d33-862c-c3eed6d55210 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:14.917007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.917789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.918070 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.918347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.923699 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:14.924507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:14.924795 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:14.925078 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:14.928342 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:14.935935 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:14.937403 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:14.938585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:14.939535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 277/553] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:14.940695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:14.960698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:14.961589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:14.967382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:14.967382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:14.967382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:14.967382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:14.967382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 277/554] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:14.967382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:14.968705 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.042516 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026191a0-f523-4337-9850-4969aa8eca88 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.057404 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.066459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d895a4-ce8c-4f2f-b637-2c5a1f1fa318 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.075461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.076155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.076441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.076714 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.077569 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:15.077876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.079303 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.096384 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 278/555] 10.222.0.94 () {56 vars in 1137 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:15.097089 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.105375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.106177 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.106467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.106745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.117195 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.119192 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:15.137607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:15.138486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:15.139344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:15.139344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:15.139344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:15.139344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:15.139344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 278/556] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:15.139627 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.178553 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.198964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753b354-cf2b-4baf-9a05-598ff5187faa None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.236501 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.237167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.237450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.237729 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.238464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] RBAC: Adding query filter params (name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:15.238766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.240162 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.241552 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664cf7f-c5c5-44e2-8864-bc55fcc0cbc8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.248558 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 279/557] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:15.249347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.276798 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.277466 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.277753 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.278038 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.278756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:15.279067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.280545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.296997 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 279/558] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:15.296997 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.298496 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.353853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b88d58-c68d-44f8-8777-37df8c65a698 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.387506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.388396 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.388632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.388913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.394127 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc63b2-7360-443b-9473-e6925c2fbc6d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.400040 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.401887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.403609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:15.419962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:15.421394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:15.422309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:15.422309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:15.422309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:15.422309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:15.422309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 280/559] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:15.422309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.431261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.431957 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.432241 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.432519 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.433229 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:15.433535 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.434894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.447158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 280/560] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:15.447958 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.514168 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.526392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a10b9-ce47-4479-a096-449bfa3a00dd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.551717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30761a-96a9-492f-acb3-112e5c85609c None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.559610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.560424 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.560714 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.560991 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.572082 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.573527 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.586089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.587450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.587755 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.588053 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:15.591097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:15.592084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:15.592972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:15.592972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:15.592972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:15.592972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:15.592972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 281/561] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:15.593255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.595517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.597396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:15.612407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:15.613439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 281/562] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:15.614447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.644883 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.700106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9721bd-b8cf-4102-ac74-fb93dca14afb None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.717002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a50cd9-6efb-4aa9-88ab-5373bfaf9b08 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.734467 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411693-b576-493f-8029-bff246d25a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.735130 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411693-b576-493f-8029-bff246d25a41 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.735420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411693-b576-493f-8029-bff246d25a41 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.735705 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411693-b576-493f-8029-bff246d25a41 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.736554 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411693-b576-493f-8029-bff246d25a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:15.736866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411693-b576-493f-8029-bff246d25a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.738256 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411693-b576-493f-8029-bff246d25a41 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.740973 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.751564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 282/563] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:15.752442 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.752634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411693-b576-493f-8029-bff246d25a41 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.753382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.753740 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.754088 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.761716 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.763151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:15.777357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:15.778369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:15.779451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:15.783114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 282/564] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:15.783953 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.851190 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411693-b576-493f-8029-bff246d25a41 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.859155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:15.883102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b2d9-a684-433b-ad9c-f0c7c87bdae1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:15.887187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.887885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.888172 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.888449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.889158 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:15.889463 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.890841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.902457 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 283/565] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:15.903180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.921069 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:15.921740 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:15.922022 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:15.922301 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:15.923192 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:15.923497 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:15.924951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:15.942561 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 283/566] 10.222.0.94 () {56 vars in 1137 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:15.943485 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:15.987252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.005721 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be068327-8c4b-4cac-bea0-ce6eba32095b None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.039039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.039870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.040670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.040945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.047481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.047855 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3d843-1ef9-4a47-b60e-485b0e1c097e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.048956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:16.063045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:16.064164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 284/567] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:16.069817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.091330 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.091528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.092117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.092407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.092689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.093475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:16.093792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.095271 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.107659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 284/568] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:16.108597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.165273 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387b42f-364f-4580-b905-f56031b8651f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.199072 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.199906 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.200196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.200478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.207467 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.208964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.210846 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b625b-e7d6-45ef-a33a-effe9685e819 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.212513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:16.223891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:16.225008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 285/569] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:16.226039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.250290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.251092 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.251382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.251664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.263137 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.264616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:16.281549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:16.282590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:16.283837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:16.283837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:16.283837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:16.283837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:16.283837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 285/570] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:16.284177 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.318517 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.333728 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd697431-7938-4a8a-a988-b0f36f30c576 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.368585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.369247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.369538 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.369817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.370598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:16.370913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.372390 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.384028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 286/571] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:16.384825 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.387236 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fecda-0fb4-47ab-909e-43f69b696e19 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.420992 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.421815 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.422101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.422382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] PATH_INFO: `/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/1cebf7555312469984252513f450b58f/roles/15dc4243dee04db2b0c9a13117f83873` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.436697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] RBAC: Authorizing `identity:create_grant(project_id=703e07bc59894ec3ab0de167388fa57b, user_id=1cebf7555312469984252513f450b58f, role_id=15dc4243dee04db2b0c9a13117f83873)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.438245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.451543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 286/572] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:31:16 2022] PUT /identity/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/1cebf7555312469984252513f450b58f/roles/15dc4243dee04db2b0c9a13117f83873 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:31:16.452476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.456094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.494041 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa1df3-4575-4c43-876e-f6a3a4eb94b6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.535222 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.535954 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.536248 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.536701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.538433 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:16.538767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.540327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.561839 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 287/573] 10.222.0.94 () {56 vars in 1139 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:16.562688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.568125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.578771 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e83eb-210b-410b-ab16-3b66a59c630e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.620436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.621117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.621406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.621693 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.623064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:16.623381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.624805 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.643861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 287/574] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:16.644717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.682209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233fc1-2311-4ebc-9c0f-9f7a6681108c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.714791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.720426 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.721328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.721615 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.721893 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] PATH_INFO: `/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/4c96f27d72744e5fb22cbe798a0cb98e/roles/15dc4243dee04db2b0c9a13117f83873` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.738464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] RBAC: Authorizing `identity:create_grant(project_id=703e07bc59894ec3ab0de167388fa57b, user_id=4c96f27d72744e5fb22cbe798a0cb98e, role_id=15dc4243dee04db2b0c9a13117f83873)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.739950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.763764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 288/575] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:31:16 2022] PUT /identity/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/4c96f27d72744e5fb22cbe798a0cb98e/roles/15dc4243dee04db2b0c9a13117f83873 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:31:16.763764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.764111 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46329b-3220-4019-95d5-d0c58aa62a8d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.808676 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.809647 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.810001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.810331 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.826078 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.828445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.831327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:16.856514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:16.857483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:16.858342 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:16.858342 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:16.858342 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:16.858342 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:16.863206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 288/576] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:16.864191 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:16.890941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ecc8b-c678-4420-9758-ec7a30e95ff7 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:16.929588 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:16.930573 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:16.930935 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:16.931261 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:16.939160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:16.940727 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:16.956133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:16.957257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:16.958357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:16.963041 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 289/577] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:16.965626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:17.026455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a3d06-af6c-4644-b249-a26810bd2d31 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:17.050756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:17.080589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:17.081270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:17.081558 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:17.082374 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:17.083112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:17.083709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:17.085402 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:17.095275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77615f59-450f-466c-a0ff-ccd427308f02 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:17.103172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 289/578] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:17.107899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:17.113616 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:17.136943 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:17.138078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:17.138368 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:17.138733 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:17.139537 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:17.139901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:17.142120 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:17.157213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 290/579] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:17.162738 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:17.238749 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caebf86-b49e-40b7-973e-59b7fdd163ea None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:17.273013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06563cd7-27d7-4711-ab12-4a05bf369698 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:17.285743 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:17.287045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:17.287537 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:17.288140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:17.297260 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:17.299631 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:17.311919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:17.312906 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:17.313259 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:17.313608 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] PATH_INFO: `/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/5904a25265304dc683441c3b110bd1b3/roles/15dc4243dee04db2b0c9a13117f83873` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:17.318455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:17.319296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:17.320299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:17.323753 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 290/580] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:17.329034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:17.338308 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=703e07bc59894ec3ab0de167388fa57b, user_id=5904a25265304dc683441c3b110bd1b3, role_id=15dc4243dee04db2b0c9a13117f83873)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:17.340580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:17.358609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 291/581] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:31:17 2022] PUT /identity/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/5904a25265304dc683441c3b110bd1b3/roles/15dc4243dee04db2b0c9a13117f83873 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:31:17.371915 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:17.448701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11b7e2-af87-496e-99a4-a8d513e63763 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:17.488430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76424c35-3dce-46e6-a237-1b86b476dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:17.489156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424c35-3dce-46e6-a237-1b86b476dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:17.489390 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424c35-3dce-46e6-a237-1b86b476dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:17.489667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424c35-3dce-46e6-a237-1b86b476dbe5 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:17.490615 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76424c35-3dce-46e6-a237-1b86b476dbe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:17.490937 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76424c35-3dce-46e6-a237-1b86b476dbe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:17.496004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76424c35-3dce-46e6-a237-1b86b476dbe5 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:17.509668 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 291/582] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:17.516266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:17.544922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:17.626928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c059ef3-cd49-4cab-898f-e65f718cabe4 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:17.666205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b0d42-2c64-4aac-bdb2-682db056d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:17.667452 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0d42-2c64-4aac-bdb2-682db056d6b4 None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:17.667946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0d42-2c64-4aac-bdb2-682db056d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:17.668367 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b0d42-2c64-4aac-bdb2-682db056d6b4 None admin] PATH_INFO: `/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/8a31482a8d184d81a5569d11fcc53181/roles/15dc4243dee04db2b0c9a13117f83873` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:17.684585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b0d42-2c64-4aac-bdb2-682db056d6b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=703e07bc59894ec3ab0de167388fa57b, user_id=8a31482a8d184d81a5569d11fcc53181, role_id=15dc4243dee04db2b0c9a13117f83873)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:17.686246 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b0d42-2c64-4aac-bdb2-682db056d6b4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:17.703884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 292/583] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:31:17 2022] PUT /identity/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/8a31482a8d184d81a5569d11fcc53181/roles/15dc4243dee04db2b0c9a13117f83873 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:31:18.731463 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ba0b-5e6e-4b77-8be8-aabdcc978d75 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:18.732031 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ba0b-5e6e-4b77-8be8-aabdcc978d75 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:18.732031 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1ba0b-5e6e-4b77-8be8-aabdcc978d75 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:18.733663 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 292/584] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:18.738975 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55cd2e-1ff8-4c07-aa53-716c06ec9733 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:18.739368 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55cd2e-1ff8-4c07-aa53-716c06ec9733 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:18.739533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55cd2e-1ff8-4c07-aa53-716c06ec9733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:18.756840 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-9f55cd2e-1ff8-4c07-aa53-716c06ec9733 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:18.758022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-9f55cd2e-1ff8-4c07-aa53-716c06ec9733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:18.826628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 293/585] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:18.850603 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ba0b-5e6e-4b77-8be8-aabdcc978d75 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:18.951281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:18.958828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1ba0b-5e6e-4b77-8be8-aabdcc978d75 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.000185 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f496-1177-4c06-b92a-91200a84cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.001273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f496-1177-4c06-b92a-91200a84cc54 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.001763 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f496-1177-4c06-b92a-91200a84cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.002202 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f496-1177-4c06-b92a-91200a84cc54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.015036 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f496-1177-4c06-b92a-91200a84cc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-c527f496-1177-4c06-b92a-91200a84cc54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:19.023389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:19.024621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:19.025652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:19.028055 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 293/586] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:19.036761 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55cd2e-1ff8-4c07-aa53-716c06ec9733 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.052090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:19.140276 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55cd2e-1ff8-4c07-aa53-716c06ec9733 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.150582 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e65f-01d1-4403-ae23-b7e4b462c544 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.150865 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e65f-01d1-4403-ae23-b7e4b462c544 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.151145 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e65f-01d1-4403-ae23-b7e4b462c544 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.152685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 294/587] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:19.157829 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d200-c60f-4be8-9836-51a46258b85a None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.158122 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d200-c60f-4be8-9836-51a46258b85a None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.158407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7d200-c60f-4be8-9836-51a46258b85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.176274 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-bcd7d200-c60f-4be8-9836-51a46258b85a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:19.176880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.177392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-bcd7d200-c60f-4be8-9836-51a46258b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:19.177589 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.177830 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.178105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.178909 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:19.179336 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:19.181463 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:19.191154 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 294/588] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:19.196737 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.262390 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 295/589] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:19.285116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:19.287182 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7d200-c60f-4be8-9836-51a46258b85a None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.333126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e072ee-346c-49fe-a173-8e439ec8a8f3 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.378713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.379503 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.379913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.380186 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.383133 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:19.394081 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:19.395977 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:19.402356 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7d200-c60f-4be8-9836-51a46258b85a None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:19.415332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:19.416301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:19.417180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:19.417180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:19.417180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:19.417180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:19.424264 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 295/590] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:19.425530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.442687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.443507 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.443821 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.444105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] PATH_INFO: `/v3/roles/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.457483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:19.467951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:19.468907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:19.469767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:19.474544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 296/591] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:19.475440 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.555869 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917ae5f-0f1e-40a9-8580-44ec38b087fd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.577925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:19.596375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393e984-f2ce-4a81-a519-c12285e30bca None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.598682 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.604032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.604745 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.605049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.605847 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:19.606106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:19.608037 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:19.630683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 296/592] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:19.638033 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.645927 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.646251 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.646585 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.646963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.647922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:19.648396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:19.650063 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:19.664503 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 297/593] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:19.665740 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.683510 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:19.774301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54435fb-d2b2-4d03-8192-03af59f6d5ea None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.796590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5406a-5303-4e1b-bb82-a620bce9a383 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:19.810687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c9f9-6b51-46a8-9541-8651a7cb66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.811688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c9f9-6b51-46a8-9541-8651a7cb66aa None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.812163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c9f9-6b51-46a8-9541-8651a7cb66aa None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.812443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c9f9-6b51-46a8-9541-8651a7cb66aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.819805 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c9f9-6b51-46a8-9541-8651a7cb66aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:19.821839 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c9f9-6b51-46a8-9541-8651a7cb66aa None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:19.831759 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bca33b-da3a-4fd2-907c-e3629bae7b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:19.832557 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bca33b-da3a-4fd2-907c-e3629bae7b70 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.832838 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bca33b-da3a-4fd2-907c-e3629bae7b70 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.833109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bca33b-da3a-4fd2-907c-e3629bae7b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-7be3c9f9-6b51-46a8-9541-8651a7cb66aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:19.836627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:19.837560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:19.838496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:19.842845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 297/594] 10.222.0.94 () {56 vars in 1093 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:19.844205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88793-640c-4309-877d-4317a95a7db1 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.844499 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88793-640c-4309-877d-4317a95a7db1 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.844784 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88793-640c-4309-877d-4317a95a7db1 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.845984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bca33b-da3a-4fd2-907c-e3629bae7b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:19.847931 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 298/595] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:19.847931 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88793-640c-4309-877d-4317a95a7db1 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.848158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bca33b-da3a-4fd2-907c-e3629bae7b70 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-e9bca33b-da3a-4fd2-907c-e3629bae7b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:19.871357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:19.872520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:19.873406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:19.873406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:19.873406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:19.873406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:19.873406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 298/596] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:19.873884 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677fbe-862a-42e4-bf4b-8570241df33d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:19.874193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677fbe-862a-42e4-bf4b-8570241df33d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:19.874472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f677fbe-862a-42e4-bf4b-8570241df33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:19.892617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-9f677fbe-862a-42e4-bf4b-8570241df33d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:19.893798 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-9f677fbe-862a-42e4-bf4b-8570241df33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:19.896894 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:19.953745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:19.965933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 299/597] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:19.966777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677fbe-862a-42e4-bf4b-8570241df33d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:19.984878 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88793-640c-4309-877d-4317a95a7db1 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.021019 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.021816 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.022100 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.022498 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.023210 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:20.023521 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.025704 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.049403 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 299/598] 10.222.0.94 () {56 vars in 1133 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:20.050128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.082743 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f677fbe-862a-42e4-bf4b-8570241df33d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.116193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df28404-f415-439a-89e4-ee7b31ae8b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.116850 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df28404-f415-439a-89e4-ee7b31ae8b34 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.117130 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df28404-f415-439a-89e4-ee7b31ae8b34 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.117401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df28404-f415-439a-89e4-ee7b31ae8b34 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.118142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df28404-f415-439a-89e4-ee7b31ae8b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:20.118453 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df28404-f415-439a-89e4-ee7b31ae8b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.119834 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df28404-f415-439a-89e4-ee7b31ae8b34 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.131620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 300/599] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:20.132901 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed7fac-dbec-42d5-b6ee-c3eaf3c5e384 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.133189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed7fac-dbec-42d5-b6ee-c3eaf3c5e384 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.133995 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed7fac-dbec-42d5-b6ee-c3eaf3c5e384 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.135240 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 301/600] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:20.135963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed7fac-dbec-42d5-b6ee-c3eaf3c5e384 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.146534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.154422 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac5498-ae7f-4a9b-9fd5-cb3a303254ea None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.187221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.188835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.189618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.189909 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.190184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.200627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:20.208328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:20.209377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:20.210226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 300/601] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:20.211236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.237818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed7fac-dbec-42d5-b6ee-c3eaf3c5e384 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.271203 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.271887 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.272177 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.272456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.309189 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441dd44-da60-4506-b6f6-9a528427850d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.338810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.340239 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.342602 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df433ad-27b8-4dd8-9194-765f6714fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.343352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df433ad-27b8-4dd8-9194-765f6714fd4c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.343639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df433ad-27b8-4dd8-9194-765f6714fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.343948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df433ad-27b8-4dd8-9194-765f6714fd4c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.352806 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df433ad-27b8-4dd8-9194-765f6714fd4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.354243 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df433ad-27b8-4dd8-9194-765f6714fd4c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-0df433ad-27b8-4dd8-9194-765f6714fd4c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:20.368214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:20.369255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 301/602] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e64c-20da-46b9-9a80-8527dbd5f7f4 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.375205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e64c-20da-46b9-9a80-8527dbd5f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.376064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7e64c-20da-46b9-9a80-8527dbd5f7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.389056 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.390474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-60e7e64c-20da-46b9-9a80-8527dbd5f7f4 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:20.391652 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-60e7e64c-20da-46b9-9a80-8527dbd5f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:20.402505 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.446768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 302/603] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:20.446768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.457130 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 302/604] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:20.461067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e64c-20da-46b9-9a80-8527dbd5f7f4 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.546977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58dc0-4096-4e6a-8a8e-3edfd8d6b019 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.558781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7e64c-20da-46b9-9a80-8527dbd5f7f4 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.579438 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.580152 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.580440 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.580730 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.581450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:20.581754 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.583120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.591397 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 303/605] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:20.591760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.592149 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.592501 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.592720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.592993 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.593837 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:20.594132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.595542 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.608662 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.613126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 303/606] 10.222.0.94 () {56 vars in 1137 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:20.613944 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.618671 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.698442 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b505044-2ab3-4188-861d-afc46b143541 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.715972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea54a4-0e95-4214-9ee1-026dcfcab933 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.732090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.732873 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.733194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.733472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.744557 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.745994 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.750692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.751474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.751779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.752060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.762883 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:20.763878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:20.764841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:20.765792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:20.765792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:20.765792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:20.765792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:20.765792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 304/607] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:20.766161 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:20.771951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:20.773079 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 304/608] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:20.779818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.832353 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.835850 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:20.871615 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f677f3-d355-46f3-a277-079222d73132 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.874359 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dc990-99bb-402f-811a-5336fbe9b0f5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:20.904305 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.905097 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.905380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.905654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.908148 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:20.908796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:20.909086 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:20.909369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:20.917661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.919093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:20.936209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:20.937117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:20.938001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:20.938001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:20.938001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:20.938001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:20.938001 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 305/609] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:20.938288 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:20.984109 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:20.985548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.044405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cb28e-1acf-404d-8bee-6a8b88589f53 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.046845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.060685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.079000 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.079660 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.079971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.080249 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.080959 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:21.081263 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.082637 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.086907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 305/610] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:21.087810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.096050 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 306/611] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:21.096050 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.186369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb917b3-e070-404b-baf5-28a167522b92 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.197109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096c03-36dc-4d38-917f-c94b553d7636 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.219999 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.220662 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.220951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.221229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.222007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] RBAC: Adding query filter params (name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:21.222675 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.223696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.230532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.231186 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.231466 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.231576 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 306/612] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:21.231759 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.232398 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.232494 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:21.232850 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.234220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.246941 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 307/613] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:21.247795 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.263224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.283613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.334938 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aee56-d819-4a4c-a32b-845296421794 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.349581 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fed199-058f-49c2-8a7a-9cb4ab05dedd None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.367126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.368455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.368740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.369014 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.379592 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.381318 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.383215 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.384548 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.384828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.385099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.391647 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.393085 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:21.398973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:21.399849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:21.400742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:21.400742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:21.400742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:21.400742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:21.400742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 307/614] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:21.401020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:21.407223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:21.408153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:21.409007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 308/615] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:21.409486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.481813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.503635 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b068d-426e-4a07-ac1f-17fc8a5b961f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.503982 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.511644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e59b5-bc0e-4006-ade2-f69eace23cab None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.538293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.539088 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.539894 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.540240 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.545692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.546479 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.546775 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.547054 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.550677 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.552161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.554198 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.555662 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:21.569281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:21.570135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:21.571528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:21.571528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:21.571528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:21.571528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:21.572128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:21.573180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:21.574246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:21.574760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 308/616] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:21.574760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.574881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 309/617] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:21.574881 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.675130 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e37a7-2147-419c-9ba6-5510caaf4471 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.677907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb93b3-4fc2-4cc2-b450-d0f137b37e2c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.706993 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.712800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.713461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.713744 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.714020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.714123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.714781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.714870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:21.715071 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.715170 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.715353 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.716110 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:21.716423 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.716510 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.717787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.727931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 310/618] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:21.728838 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.729538 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 309/619] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:21.730239 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.749038 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.831693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630cf8d-9571-4811-bad4-622d1e3c4637 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.833430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de215-d8ea-42a6-98b7-fa439111554e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:21.865808 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.866458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.866739 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.867010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.867624 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:21.867769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:21.868060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.868325 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:21.868616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:21.868895 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:21.869453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.869726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:21.870045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:21.871468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:21.880845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 310/620] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:21.881640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.897988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 311/621] 10.222.0.94 () {56 vars in 1137 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:21.897988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:21.929989 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.974377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:21.982734 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1116f4-94cb-4839-a0e6-389c987dc00b None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.002212 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff55501-a213-4c0b-ac3d-245118013525 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.016035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.016691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.016972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.017245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.018060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=1cebf7555312469984252513f450b58f) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:22.018369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.019806 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.025964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 311/622] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/role_assignments?user.id=1cebf7555312469984252513f450b58f&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:22.026824 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.038097 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.039010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.041045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.041045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.050338 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.052307 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:22.070514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:22.071925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 312/623] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:22.072822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.147426 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96abb1d-c824-47c4-9646-51beafa22483 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.163228 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:22.186964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.187917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.188272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.188617 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.197981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.199424 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.202361 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3290fa3-0471-4cec-8557-30776b9ec873 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:22.215163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:22.216363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:22.217420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 312/624] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:22.218013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.252494 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.253173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.253459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.253743 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.256805 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:22.332341 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91043007-2cb0-48ae-853c-18af78ec1eb5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.333531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.335145 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.368668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.369624 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.369912 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.370193 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.370984 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:22.371300 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.372771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.385981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 313/625] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:22.386808 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.426122 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:22.458094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 313/626] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:22.458094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.493875 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:22.501574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0b205-0cd7-4a6a-ae09-f38f26ea1eaa None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.537863 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.538556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.538913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.539262 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.540854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:22.541241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.542806 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.565309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 314/627] 10.222.0.94 () {56 vars in 1139 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:22.565309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.572238 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992012f-25fa-4290-be09-ce709b34b96d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.608752 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.609566 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.610008 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.610326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.611255 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=4c96f27d72744e5fb22cbe798a0cb98e) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:22.611676 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.613292 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.620029 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 314/628] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/role_assignments?user.id=4c96f27d72744e5fb22cbe798a0cb98e&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:22.620900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.674028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:22.686253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f341c-3232-4f00-b95b-e41a79a4b839 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.725271 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.726471 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.726887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.727243 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.741221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.744354 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.744984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:22.751496 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75d945-e591-4b69-8c55-32eb9b4ae610 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:22.767855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:22.768987 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:22.769880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:22.769880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:22.769880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:22.769880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:22.771894 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 315/629] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:22.775912 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.799386 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.800102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.800459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.800810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.885206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.886679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.900353 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b0e7-9f05-4d8c-8dfc-b6558b9f1049 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:22.941162 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:22.941372 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:22.941632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:22.942175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:22.942779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:22.942965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:22.945337 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:22.956926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 316/630] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:22.964430 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:22.968190 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:23.020452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:23.027200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 315/631] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:23.033391 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:23.097797 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a5b23-6734-4dbc-ad34-34c6b612190f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.136133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.137428 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.137935 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.138778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.143250 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60f460-c4ea-48cd-9a64-b97d4e5891af None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.147135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.148897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:23.165345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:23.166293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:23.167164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:23.169860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 317/632] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:23.177161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:23.184980 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.185788 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.186075 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.186353 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.197043 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.198492 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:23.217653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:23.218596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:23.219481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:23.219481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:23.219481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:23.219481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:23.219481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 316/633] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:23.228419 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:23.252112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:23.294706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:23.314173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a4664-0c7f-408b-bffe-3c2307bf4120 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.348774 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7cfcf-1c6b-47f8-941f-091264cc27a3 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.353362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.354031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.354317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.354598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.355381 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:23.355691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.357139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.369360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 318/634] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:23.376010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:23.390653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.391323 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.391607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.391929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.392705 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:23.393013 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.394368 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.411115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 317/635] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:23.412029 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:23.506376 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff68e-b352-4c95-8804-f66c556adcfe None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.518758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc22e5-3717-4d5a-a55b-220f7cd88c4b None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.530036 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:23.537271 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:23.552064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.552891 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.553181 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.553458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.554597 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=5904a25265304dc683441c3b110bd1b3) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:23.555597 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.557458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.559781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.560808 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.561302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.561770 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.564695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 319/636] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:23 2022] GET /identity/v3/role_assignments?user.id=5904a25265304dc683441c3b110bd1b3&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:23.573589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.575465 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:23.592010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:23.592968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:23.593859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:23.596286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 318/637] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:23.601598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:23.733728 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94a57-316a-493e-8c53-d3d215e43c7c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.769886 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab310225-163c-44bb-b6ea-c4c98aa1786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.770547 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab310225-163c-44bb-b6ea-c4c98aa1786f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.770831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab310225-163c-44bb-b6ea-c4c98aa1786f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.771107 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab310225-163c-44bb-b6ea-c4c98aa1786f None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.771925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab310225-163c-44bb-b6ea-c4c98aa1786f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:23.772233 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab310225-163c-44bb-b6ea-c4c98aa1786f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.773687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab310225-163c-44bb-b6ea-c4c98aa1786f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.787944 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 320/638] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:23.794322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:23.903954 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc710b0-9bdd-4261-bcde-d2a47b16d0a9 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:23.942254 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021db2cb-8234-464c-b311-fe4418590794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:23.943184 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021db2cb-8234-464c-b311-fe4418590794 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:23.943609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021db2cb-8234-464c-b311-fe4418590794 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:23.944085 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021db2cb-8234-464c-b311-fe4418590794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:23.945064 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021db2cb-8234-464c-b311-fe4418590794 None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=8a31482a8d184d81a5569d11fcc53181) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:23.946061 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021db2cb-8234-464c-b311-fe4418590794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:23.947719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021db2cb-8234-464c-b311-fe4418590794 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:23.954876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 319/639] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:23 2022] GET /identity/v3/role_assignments?user.id=8a31482a8d184d81a5569d11fcc53181&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:24.412801 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa2952-b708-4161-8817-8487fc60d920 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:24.413315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa2952-b708-4161-8817-8487fc60d920 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:24.413415 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa2952-b708-4161-8817-8487fc60d920 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:24.415723 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 321/640] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:24.421264 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b56df-59d2-47c8-970e-be2bf58a0afa None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:24.421561 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b56df-59d2-47c8-970e-be2bf58a0afa None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:24.421840 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b56df-59d2-47c8-970e-be2bf58a0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:24.441387 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-5c4b56df-59d2-47c8-970e-be2bf58a0afa None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:24.442600 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-5c4b56df-59d2-47c8-970e-be2bf58a0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:24.472587 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:24.522623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 320/641] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:31:24.547022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa2952-b708-4161-8817-8487fc60d920 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:24.604046 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:24.657765 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa2952-b708-4161-8817-8487fc60d920 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:24.693099 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:24.693812 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:24.694091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:24.694363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:24.705541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:24.713540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:24.714510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:24.715392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 322/642] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:24.725109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b56df-59d2-47c8-970e-be2bf58a0afa None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:24.832705 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b56df-59d2-47c8-970e-be2bf58a0afa None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:24.869282 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb957-e59b-4527-b0f1-cffd849c962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:24.869960 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb957-e59b-4527-b0f1-cffd849c962c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:24.870249 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb957-e59b-4527-b0f1-cffd849c962c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:24.870529 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb957-e59b-4527-b0f1-cffd849c962c None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:24.871379 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb957-e59b-4527-b0f1-cffd849c962c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:24.871696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb957-e59b-4527-b0f1-cffd849c962c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:24.873191 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb957-e59b-4527-b0f1-cffd849c962c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:24.883077 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 321/643] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:24.888872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:24.998932 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7037d-c614-4fa1-9926-8f036b140090 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.008393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:25.035664 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.036785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.037074 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.037352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.049603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.052245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.055340 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51aaf7-ee4b-4962-8b9c-5bdd1693c1bd None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.055824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51aaf7-ee4b-4962-8b9c-5bdd1693c1bd None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.056003 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51aaf7-ee4b-4962-8b9c-5bdd1693c1bd None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.057428 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 322/644] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:25.062672 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704ddc-11dd-4c2c-a275-874a5544e25a None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.063222 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704ddc-11dd-4c2c-a275-874a5544e25a None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.063576 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6704ddc-11dd-4c2c-a275-874a5544e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:25.076306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:25.077291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:25.078208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:25.078208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:25.078208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:25.078208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:25.080278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 323/645] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:25.084771 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-d6704ddc-11dd-4c2c-a275-874a5544e25a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:25.084771 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-d6704ddc-11dd-4c2c-a275-874a5544e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:25.085879 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:25.112079 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:25.173867 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 323/646] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:31:25.196970 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6704ddc-11dd-4c2c-a275-874a5544e25a None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:25.222033 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034ddd2-1656-45b1-bc7a-ab59f989d69e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.275558 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.277152 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.277618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.278314 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.279199 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:25.279996 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.282441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.303751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 324/647] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:25.304896 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:25.313092 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6704ddc-11dd-4c2c-a275-874a5544e25a None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.329023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:25.351398 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.352255 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.352539 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.352817 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] PATH_INFO: `/v3/services/image` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.353473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.354899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:25.368984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:25.370247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:25.371225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:25.375150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 324/648] 10.222.0.94 () {56 vars in 1105 bytes} [Fri Jul 15 15:31:25 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:25.376203 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:25.400955 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:25.423492 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6274b3-8837-45c9-909b-4f57159c64bb None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.460690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.462412 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.462849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.463273 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.471145 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.472823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.485371 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca262-cc79-4f8f-9604-ee5f0cc6a4da None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:25.487998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:25.489094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:25.490126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:25.496792 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 325/649] 10.222.0.94 () {56 vars in 1093 bytes} [Fri Jul 15 15:31:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:25.497889 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:25.522184 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.522906 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.523188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.523522 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.524436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] RBAC: Adding query filter params (name=image) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:25.524557 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.525964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.535772 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 325/650] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:25.536661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:25.588800 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:25.610830 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e7b5-c5b7-40f6-8f0e-403b2e31befc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.632089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:25.650819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b12c-0505-4c9b-9cb3-6989532db55e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.650997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.651859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.652417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.652842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.653885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:25.654343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.656366 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.680834 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 326/651] 10.222.0.94 () {56 vars in 1133 bytes} [Fri Jul 15 15:31:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:25.682143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:25.687559 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78898711-a672-4566-ac3f-89a44d8eea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.688261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898711-a672-4566-ac3f-89a44d8eea03 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.688545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898711-a672-4566-ac3f-89a44d8eea03 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.688823 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78898711-a672-4566-ac3f-89a44d8eea03 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.689534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898711-a672-4566-ac3f-89a44d8eea03 None admin] RBAC: Adding query filter params (type=image) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:25.689842 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898711-a672-4566-ac3f-89a44d8eea03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.691220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78898711-a672-4566-ac3f-89a44d8eea03 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.704009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 326/652] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:25.800022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e332906-9f5b-4926-aabd-d46f54bbdbcc None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:25.843887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:25.844989 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.845429 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.845857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.855719 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:25.924105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:25.925678 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:25.973048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745129-dc7b-4cb8-b1ff-8c261e6cb0de None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.973326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745129-dc7b-4cb8-b1ff-8c261e6cb0de None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.973608 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e745129-dc7b-4cb8-b1ff-8c261e6cb0de None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.976286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 327/653] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:25.980522 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049786-45ea-4fe7-9c72-16434a822dfb None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:25.980814 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049786-45ea-4fe7-9c72-16434a822dfb None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:25.981101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91049786-45ea-4fe7-9c72-16434a822dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:25.998077 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-91049786-45ea-4fe7-9c72-16434a822dfb None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:25.999359 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-91049786-45ea-4fe7-9c72-16434a822dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:26.043904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 327/654] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 15:31:26.049380 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.087948 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 328/655] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:26.098607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:26.113965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91049786-45ea-4fe7-9c72-16434a822dfb None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.182941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c8b4e-0014-4eec-b9b0-9a9c09aa99cb None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.216665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:26.226153 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a496be-c9de-4776-a867-4073517276ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.227390 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a496be-c9de-4776-a867-4073517276ad None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.227962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a496be-c9de-4776-a867-4073517276ad None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.228737 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a496be-c9de-4776-a867-4073517276ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.240841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a496be-c9de-4776-a867-4073517276ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.243090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91049786-45ea-4fe7-9c72-16434a822dfb None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.243644 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a496be-c9de-4776-a867-4073517276ad None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-80a496be-c9de-4776-a867-4073517276ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:26.264965 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:26.265915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:26.266809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:26.266809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:26.266809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:26.266809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:26.266809 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 328/656] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:26.271888 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a496be-c9de-4776-a867-4073517276ad None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.285325 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.286587 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.287011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.287454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.288143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.290119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:26.306475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:26.307531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:26.308392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:26.311828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 329/657] 10.222.0.94 () {56 vars in 1129 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:26.317686 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.374283 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:26.385578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a496be-c9de-4776-a867-4073517276ad None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.421243 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2a189-611c-47e2-8ad4-15ad8c2a2ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.421988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a189-611c-47e2-8ad4-15ad8c2a2ed6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.422279 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a189-611c-47e2-8ad4-15ad8c2a2ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.422556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a189-611c-47e2-8ad4-15ad8c2a2ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.423270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2a189-611c-47e2-8ad4-15ad8c2a2ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:26.423574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2a189-611c-47e2-8ad4-15ad8c2a2ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.424970 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2a189-611c-47e2-8ad4-15ad8c2a2ed6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.431561 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948aef6-9a37-4448-828d-8aa198453670 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.436496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 329/658] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:26.438048 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ece8-706b-4261-b815-d71cd82b0806 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.438498 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ece8-706b-4261-b815-d71cd82b0806 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.438984 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ece8-706b-4261-b815-d71cd82b0806 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.440403 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 330/659] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:26.445132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ece8-706b-4261-b815-d71cd82b0806 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.471452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5657ce-2e99-4718-8c1c-5f8e7792d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.472116 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5657ce-2e99-4718-8c1c-5f8e7792d8db None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.472400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5657ce-2e99-4718-8c1c-5f8e7792d8db None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.472678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5657ce-2e99-4718-8c1c-5f8e7792d8db None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.473378 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5657ce-2e99-4718-8c1c-5f8e7792d8db None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:26.473684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5657ce-2e99-4718-8c1c-5f8e7792d8db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.475039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5657ce-2e99-4718-8c1c-5f8e7792d8db None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.480406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 330/660] 10.222.0.94 () {56 vars in 1124 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:26.487889 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67945-a8ab-4130-b1db-4140c3d95c5d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.488182 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67945-a8ab-4130-b1db-4140c3d95c5d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.488463 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af67945-a8ab-4130-b1db-4140c3d95c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.500589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:26.506419 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8af67945-a8ab-4130-b1db-4140c3d95c5d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:26.507710 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8af67945-a8ab-4130-b1db-4140c3d95c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:26.556226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ece8-706b-4261-b815-d71cd82b0806 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.580642 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 331/661] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:26.581791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af67945-a8ab-4130-b1db-4140c3d95c5d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.596605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.597396 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.597690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.597949 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.606097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.607584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:26.621751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:26.622603 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:26.623485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 331/662] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:26.624027 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.640824 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:26.704639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af67945-a8ab-4130-b1db-4140c3d95c5d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.735450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387ac4-409c-4046-8bad-b38386839830 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.739696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.740459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.740742 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.741036 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.741717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:26.742021 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.743418 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.745486 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:26.749510 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 332/663] 10.222.0.94 () {56 vars in 1124 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:26.750669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.786360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.787774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.788494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.789447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] PATH_INFO: `/v3/services/network` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.790592 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.792955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:26.813857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:26.815160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:26.816150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:26.817353 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 332/664] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:26.823537 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.888918 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72d213-b332-4189-9369-4481470f4309 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.915358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:26.944090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.944881 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bacc48-17e8-4add-9c5b-7eaf4b4a29ad None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:26.945954 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.946437 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.946932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.948239 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:26.950570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:26.951051 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:26.967048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 333/665] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:26.973531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:26.996696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:26.997474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:26.997833 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:26.998185 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:26.998991 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] RBAC: Adding query filter params (name=network) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:26.999367 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:27.000875 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:27.006691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 333/666] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:27.012852 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:27.054343 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:27.112561 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03024f-6892-4705-8ba6-f97f9acc0a14 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:27.150018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d23ca-6186-4408-b64c-40afe7fca1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:27.150958 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d23ca-6186-4408-b64c-40afe7fca1c5 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:27.151424 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d23ca-6186-4408-b64c-40afe7fca1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:27.151867 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d23ca-6186-4408-b64c-40afe7fca1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:27.153054 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d23ca-6186-4408-b64c-40afe7fca1c5 None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=1cebf7555312469984252513f450b58f) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:27.153269 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952391-b00f-4036-b19f-b118192c0c2c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:27.153691 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d23ca-6186-4408-b64c-40afe7fca1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:27.155462 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d23ca-6186-4408-b64c-40afe7fca1c5 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:27.162309 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 334/667] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:26 2022] GET /identity/v3/role_assignments?user.id=1cebf7555312469984252513f450b58f&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=8442e7332b934407beff8c3564575b62 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:27.198436 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9c89c-d7ba-44b5-bd73-29245b87acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:27.199439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c89c-d7ba-44b5-bd73-29245b87acef None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:27.199856 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c89c-d7ba-44b5-bd73-29245b87acef None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:27.200245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9c89c-d7ba-44b5-bd73-29245b87acef None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:27.201253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9c89c-d7ba-44b5-bd73-29245b87acef None admin] RBAC: Adding query filter params (type=network) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:27.201794 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9c89c-d7ba-44b5-bd73-29245b87acef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:27.203285 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9c89c-d7ba-44b5-bd73-29245b87acef None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:27.210714 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 334/668] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:28.148499 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ed07-9efd-45a1-a04f-f564f85f685d None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:28.149021 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ed07-9efd-45a1-a04f-f564f85f685d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:28.149101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ed07-9efd-45a1-a04f-f564f85f685d None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:28.150676 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 335/669] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:28.156182 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1193-818d-4803-9dd7-829dbd6cc97b None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:28.156579 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1193-818d-4803-9dd7-829dbd6cc97b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:28.156750 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1193-818d-4803-9dd7-829dbd6cc97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:28.161766 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:28.176414 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6d9d1193-818d-4803-9dd7-829dbd6cc97b None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:28.177925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6d9d1193-818d-4803-9dd7-829dbd6cc97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:28.248966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 335/670] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 15:31:28.275015 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ed07-9efd-45a1-a04f-f564f85f685d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:28.385866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ed07-9efd-45a1-a04f-f564f85f685d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:28.411665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:28.424683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17466693-8085-4f42-b48a-29ad97982848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:28.425634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17466693-8085-4f42-b48a-29ad97982848 None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:28.426142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17466693-8085-4f42-b48a-29ad97982848 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:28.426618 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17466693-8085-4f42-b48a-29ad97982848 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:28.427543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17466693-8085-4f42-b48a-29ad97982848 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:28.429143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17466693-8085-4f42-b48a-29ad97982848 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:28.447820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 336/671] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:31:28 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:29.160463 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0101d2-e831-41fe-82bd-010e05b38d97 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.160970 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0101d2-e831-41fe-82bd-010e05b38d97 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.161085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0101d2-e831-41fe-82bd-010e05b38d97 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.162815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 336/672] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:29.168635 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a284d0a-dea3-43cf-ad92-e07ae968afc9 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.169188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a284d0a-dea3-43cf-ad92-e07ae968afc9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.169481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a284d0a-dea3-43cf-ad92-e07ae968afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.187934 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8a284d0a-dea3-43cf-ad92-e07ae968afc9 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:29.189154 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8a284d0a-dea3-43cf-ad92-e07ae968afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:29.276765 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 337/673] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:29 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:29.300991 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0101d2-e831-41fe-82bd-010e05b38d97 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:29.419610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0101d2-e831-41fe-82bd-010e05b38d97 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:29.449948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:29.455680 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32545d6-87f0-4afa-81e1-67530ea53dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:29.456367 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32545d6-87f0-4afa-81e1-67530ea53dee None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.456649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32545d6-87f0-4afa-81e1-67530ea53dee None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.456926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32545d6-87f0-4afa-81e1-67530ea53dee None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.457651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32545d6-87f0-4afa-81e1-67530ea53dee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:29.459022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32545d6-87f0-4afa-81e1-67530ea53dee None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:29.475112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca224b5-d93d-4e3c-9c07-3c6925d463f3 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.475424 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca224b5-d93d-4e3c-9c07-3c6925d463f3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.475685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca224b5-d93d-4e3c-9c07-3c6925d463f3 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.475876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 337/674] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:31:29 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:29.477931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 338/675] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:29.483798 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac4a9-d998-4c2a-aa2d-a31d76e30114 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.484101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac4a9-d998-4c2a-aa2d-a31d76e30114 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.484379 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac4a9-d998-4c2a-aa2d-a31d76e30114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.508061 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-280ac4a9-d998-4c2a-aa2d-a31d76e30114 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:29.509386 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-280ac4a9-d998-4c2a-aa2d-a31d76e30114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:29.595604 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 338/676] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:29 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:29.619518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca224b5-d93d-4e3c-9c07-3c6925d463f3 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:29.737165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca224b5-d93d-4e3c-9c07-3c6925d463f3 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:29.748982 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:29.777530 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:29.778330 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.778614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.778891 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.791095 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:29.799531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb204-8eb5-4926-ba95-7515a1300c44 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.799848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb204-8eb5-4926-ba95-7515a1300c44 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.800128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb204-8eb5-4926-ba95-7515a1300c44 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.801759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 339/677] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:29.803409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:29.804423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:29.805797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 339/678] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:31:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:29.810241 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931558-3c94-42ae-9225-9e3469f0f956 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.810536 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931558-3c94-42ae-9225-9e3469f0f956 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.810814 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931558-3c94-42ae-9225-9e3469f0f956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.814296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:29.829083 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-5c931558-3c94-42ae-9225-9e3469f0f956 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:29.830258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-5c931558-3c94-42ae-9225-9e3469f0f956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:29.902741 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 340/679] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:29 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 15:31:29.920650 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18dbd7-294d-4670-9f97-218a2a378744 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:29.927781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931558-3c94-42ae-9225-9e3469f0f956 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:29.957041 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:29.958014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:29.958435 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:29.958844 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:29.959590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:29.959928 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:29.963078 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:29.974081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 340/680] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:29.979632 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:30.004110 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.016514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.053097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931558-3c94-42ae-9225-9e3469f0f956 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:30.107470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:30.108884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.109174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.109455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.110184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:30.111563 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:30.118200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eba39-6441-40f6-bb13-ee40e98092be None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:30.132673 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 341/681] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:31:29 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:31:30.172851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:30.174382 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.175066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.175538 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.189876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:30.191867 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:30.212890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:30.213876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:30.214766 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:30.214766 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:30.214766 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:30.214766 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:30.217004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 341/682] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:30.222829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:30.341390 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68938a1-1dc6-40b0-bbe0-254b85b31623 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:30.354222 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.385495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:30.386166 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.386447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.386718 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.387443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:30.387873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:30.389243 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:30.403514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 342/683] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:30.408663 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:30.499600 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.521571 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bf594-dfcd-402a-b9f2-3f584b3fe2f8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:30.557664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:30.558913 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.559424 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.559930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.568536 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:30.570840 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:30.585791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:30.586727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:30.587670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:30.590320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 342/684] 10.222.0.94 () {56 vars in 1093 bytes} [Fri Jul 15 15:31:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:30.595797 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:30.709711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8e93-1b71-45e7-9da7-3dc7ce45338e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:30.749149 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347acd6c-f188-4c79-b74b-df9c61980b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:30.750245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347acd6c-f188-4c79-b74b-df9c61980b84 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.750777 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347acd6c-f188-4c79-b74b-df9c61980b84 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.751259 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347acd6c-f188-4c79-b74b-df9c61980b84 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.752352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347acd6c-f188-4c79-b74b-df9c61980b84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:30.752887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347acd6c-f188-4c79-b74b-df9c61980b84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:30.754804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347acd6c-f188-4c79-b74b-df9c61980b84 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:30.776507 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 343/685] 10.222.0.94 () {56 vars in 1133 bytes} [Fri Jul 15 15:31:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:30.782455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:30.795092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d6c51-7395-4213-8c88-b597a6f17e3f None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.795416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d6c51-7395-4213-8c88-b597a6f17e3f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.795668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d6c51-7395-4213-8c88-b597a6f17e3f None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.797376 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 344/686] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:30.802445 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185fe7-1437-426e-9696-4bf8fd731ab3 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.802889 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185fe7-1437-426e-9696-4bf8fd731ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.803323 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e185fe7-1437-426e-9696-4bf8fd731ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.824339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-2e185fe7-1437-426e-9696-4bf8fd731ab3 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:30.826773 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-2e185fe7-1437-426e-9696-4bf8fd731ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:30.855036 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.914567 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b156-9cb9-4c76-a10d-f986532d8110 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:30.916793 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 345/687] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:31:30.944219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185fe7-1437-426e-9696-4bf8fd731ab3 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:30.959596 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:30.961423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:30.961864 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:30.962592 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:30.975193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:30.982169 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:30.985048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:31.010273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:31.011207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:31.012143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:31.012143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:31.012143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:31.012143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:31.013495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 343/688] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:31.019034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.081754 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e185fe7-1437-426e-9696-4bf8fd731ab3 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.120282 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.121404 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.121808 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.122393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.123060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.124632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:31.140486 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:31.141470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:31.142287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 346/689] 10.222.0.94 () {56 vars in 1105 bytes} [Fri Jul 15 15:31:30 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:31.147431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.148864 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de3588-894a-4fea-bb6a-e1eebc38b24d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.177273 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:31.198240 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.199845 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.201259 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.201723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.202691 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:31.203186 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.204841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.227009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 344/690] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:31.227648 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.280936 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebc2e0-e5cc-4c0d-a1cf-4078305c52a5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.302645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:31.328594 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.329267 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.329557 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.329843 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.330864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] RBAC: Adding query filter params (name=image) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:31.330864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.332280 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.337709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 347/691] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:31.342807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.368819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f0cbb-3af3-456a-9b64-1c4ad2acd141 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.412375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.413210 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.414329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.414611 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.425055 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.427172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:31.446153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:31.447099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:31.448010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:31.448532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:31.450516 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 345/692] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:31.455477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.469804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0784b-ae1c-4170-9225-06bf319460b9 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.509032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.509709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.509995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.510273 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.510984 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] RBAC: Adding query filter params (type=image) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:31.511295 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.512712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.520025 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 348/693] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:31.526025 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.583844 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829889-cd62-4689-8986-8788b5a8e869 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.599234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:31.625136 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.625806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.626091 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.626366 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.627145 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:31.627527 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.629244 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.630234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3605a5-13f5-45bb-9408-1cfd8beb1dd5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.648781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 346/694] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:31.649664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.666398 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.667063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.667348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.667623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.668453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] RBAC: Adding query filter params (interface=public, service_id=eabbc5dff8fe4c24b0e25e245deb419a, region_id=RegionOne) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:31.668763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.670131 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.683024 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 349/695] 10.222.0.94 () {56 vars in 1251 bytes} [Fri Jul 15 15:31:31 2022] GET /identity/v3/endpoints?service_id=eabbc5dff8fe4c24b0e25e245deb419a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:31.683925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:31.699611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:31.758427 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20531df-d714-47cd-82f2-f04e02990b23 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.792691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f02ce9-2946-4341-bbe4-0ad1e4fcb27e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:31.798584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93667b8f-e8bd-496e-b0ee-35d71d2035d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.799491 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667b8f-e8bd-496e-b0ee-35d71d2035d5 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.799803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667b8f-e8bd-496e-b0ee-35d71d2035d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.800087 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93667b8f-e8bd-496e-b0ee-35d71d2035d5 None admin] PATH_INFO: `/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/1cebf7555312469984252513f450b58f/roles/8442e7332b934407beff8c3564575b62` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.802580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93667b8f-e8bd-496e-b0ee-35d71d2035d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=703e07bc59894ec3ab0de167388fa57b, user_id=1cebf7555312469984252513f450b58f, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.804979 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93667b8f-e8bd-496e-b0ee-35d71d2035d5 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.827892 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 347/696] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:31:31 2022] PUT /identity/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/1cebf7555312469984252513f450b58f/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:31:31.838196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d5e3-a02f-4142-aa72-2f4ec03b05f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:31.838812 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d5e3-a02f-4142-aa72-2f4ec03b05f2 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.839097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d5e3-a02f-4142-aa72-2f4ec03b05f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.839436 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d5e3-a02f-4142-aa72-2f4ec03b05f2 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.840192 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61d5e3-a02f-4142-aa72-2f4ec03b05f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:31.841674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61d5e3-a02f-4142-aa72-2f4ec03b05f2 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:31.849322 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 350/697] 10.222.0.94 () {56 vars in 1087 bytes} [Fri Jul 15 15:31:31 2022] GET /identity/v3/services => generated 1002 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:31:31.923634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c505724-5e70-4f5b-a64a-4114ac3ed6c9 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.924015 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c505724-5e70-4f5b-a64a-4114ac3ed6c9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.924233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c505724-5e70-4f5b-a64a-4114ac3ed6c9 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.925761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 348/698] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:31.931731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3552e-5a2a-4935-9091-9a9ffba6c87b None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:31.932104 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3552e-5a2a-4935-9091-9a9ffba6c87b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:31.932392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3552e-5a2a-4935-9091-9a9ffba6c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:31.951959 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-66e3552e-5a2a-4935-9091-9a9ffba6c87b None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:31.953196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-66e3552e-5a2a-4935-9091-9a9ffba6c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:32.039164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 351/699] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:32.063183 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c505724-5e70-4f5b-a64a-4114ac3ed6c9 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.098754 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:32.178074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c505724-5e70-4f5b-a64a-4114ac3ed6c9 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:32.220942 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:32.222556 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.223092 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.223579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.224472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:32.226033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:32.239498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:32.240531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:32.241373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:32.244898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 349/700] 10.222.0.94 () {56 vars in 1129 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:32.250410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3552e-5a2a-4935-9091-9a9ffba6c87b None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.262984 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:32.358119 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3552e-5a2a-4935-9091-9a9ffba6c87b None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:32.396533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43255845-a799-44fe-81d7-ecc3f4073f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:32.397217 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43255845-a799-44fe-81d7-ecc3f4073f6b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.397508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43255845-a799-44fe-81d7-ecc3f4073f6b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.397790 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43255845-a799-44fe-81d7-ecc3f4073f6b None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.398746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43255845-a799-44fe-81d7-ecc3f4073f6b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:32.399061 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43255845-a799-44fe-81d7-ecc3f4073f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:32.400538 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43255845-a799-44fe-81d7-ecc3f4073f6b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:32.406709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 352/701] 10.222.0.94 () {56 vars in 1124 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:32.413003 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.522172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:32.528655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def455b-7a46-4732-805f-9cffb3a77be6 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:32.565433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:32.566112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.566399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.566685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.567393 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:32.567702 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:32.570768 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ccbe-14fb-4317-92b9-1a57db832a2f None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.570768 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ccbe-14fb-4317-92b9-1a57db832a2f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.570768 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ccbe-14fb-4317-92b9-1a57db832a2f None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.571025 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:32.571098 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 353/702] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:32.575414 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 350/703] 10.222.0.94 () {56 vars in 1124 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:32.576366 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abe87-60c2-4a81-bf82-8de36b3a5a45 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.576711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abe87-60c2-4a81-bf82-8de36b3a5a45 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.577000 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abe87-60c2-4a81-bf82-8de36b3a5a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.582048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.595793 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-459abe87-60c2-4a81-bf82-8de36b3a5a45 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:32.597000 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-459abe87-60c2-4a81-bf82-8de36b3a5a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:32.676170 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:32.679906 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 354/704] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:31:32.704738 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459abe87-60c2-4a81-bf82-8de36b3a5a45 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.715228 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f76c0-610a-4872-bd94-2e799e53ea60 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:32.751778 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:32.752461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.752750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.753054 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.753822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] RBAC: Adding query filter params (interface=public, service_id=839284a9b20645af82ef8f39a34c2414, region_id=RegionOne) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:32.754322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:32.756050 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:32.769608 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 351/705] 10.222.0.94 () {56 vars in 1251 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/endpoints?service_id=839284a9b20645af82ef8f39a34c2414&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:32.770679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.798293 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:32.820449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459abe87-60c2-4a81-bf82-8de36b3a5a45 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:32.859041 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:32.860159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.860614 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.861204 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] PATH_INFO: `/v3/services/network` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.862409 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:32.864278 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:32.881236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:32.882473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:32.883583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:32.884639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2adeb-48e8-49b2-9d62-4842ce942705 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:32.891172 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 355/706] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:32.892324 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:32.929322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:32.930468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:32.930692 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:32.930973 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:32.931654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:32.933046 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:32.943763 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 352/707] 10.222.0.94 () {56 vars in 1087 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/services => generated 1002 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:31:32.990060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:33.033136 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea988b-7229-405d-91ed-f8350f8b9b53 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:33.072168 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:33.073229 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:33.073725 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:33.074236 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:33.075167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] RBAC: Adding query filter params (name=network) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:33.075695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:33.077435 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:33.083479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 356/708] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:33.090304 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:33.194477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:33.209757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd39f8-2ac5-4639-b6fb-0a858fb8608f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:33.247270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:33.248002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:33.248250 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:33.248528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:33.249234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] RBAC: Adding query filter params (type=network) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:33.249545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:33.250907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:33.256669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 353/709] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:33.262902 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:33.367904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e736f3-b758-470f-8128-7575f237cd9d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:33.395823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:33.411482 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd74ef-c245-4977-8eb7-81fd2c27920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:33.412498 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd74ef-c245-4977-8eb7-81fd2c27920d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:33.413039 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd74ef-c245-4977-8eb7-81fd2c27920d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:33.414065 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd74ef-c245-4977-8eb7-81fd2c27920d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:33.415066 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd74ef-c245-4977-8eb7-81fd2c27920d None admin] RBAC: Adding query filter params (interface=public, service_id=7143f6e59d2746fca6ba940cea07b87f, region_id=RegionOne) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:33.415594 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd74ef-c245-4977-8eb7-81fd2c27920d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:33.417618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd74ef-c245-4977-8eb7-81fd2c27920d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:33.423797 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 357/710] 10.222.0.94 () {56 vars in 1251 bytes} [Fri Jul 15 15:31:33 2022] GET /identity/v3/endpoints?service_id=7143f6e59d2746fca6ba940cea07b87f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:33.428817 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:33.539122 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ba2d9-3b70-4e91-a03a-06a1894c03d0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:33.573934 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7266b-6865-4f9c-ae38-541382a07e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:33.574600 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7266b-6865-4f9c-ae38-541382a07e2a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:33.574882 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7266b-6865-4f9c-ae38-541382a07e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:33.575161 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7266b-6865-4f9c-ae38-541382a07e2a None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:33.575865 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7266b-6865-4f9c-ae38-541382a07e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:33.577231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7266b-6865-4f9c-ae38-541382a07e2a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:33.583048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 354/711] 10.222.0.94 () {56 vars in 1087 bytes} [Fri Jul 15 15:31:33 2022] GET /identity/v3/services => generated 1002 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:31:34.245957 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086429f-592e-4719-a9bf-f38372fb0380 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.246360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086429f-592e-4719-a9bf-f38372fb0380 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.246539 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086429f-592e-4719-a9bf-f38372fb0380 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.249666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 358/712] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:34.254947 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74eed0-091b-4221-9f2f-0a6f04fd23db None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.255467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74eed0-091b-4221-9f2f-0a6f04fd23db None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.255542 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74eed0-091b-4221-9f2f-0a6f04fd23db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.279771 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-0b74eed0-091b-4221-9f2f-0a6f04fd23db None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:34.281016 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-0b74eed0-091b-4221-9f2f-0a6f04fd23db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:34.296228 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:34.362769 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 355/713] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:34.387522 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086429f-592e-4719-a9bf-f38372fb0380 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:34.408617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4da4fb-f576-4e7e-8329-d82c005655c1 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.408617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4da4fb-f576-4e7e-8329-d82c005655c1 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.408617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4da4fb-f576-4e7e-8329-d82c005655c1 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.409326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 356/714] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:34.414951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dbe56-12bf-4852-82af-245b3d662fdd None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.415473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dbe56-12bf-4852-82af-245b3d662fdd None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.416012 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dbe56-12bf-4852-82af-245b3d662fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.435048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-4e8dbe56-12bf-4852-82af-245b3d662fdd None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:34.436625 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-4e8dbe56-12bf-4852-82af-245b3d662fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:34.502711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086429f-592e-4719-a9bf-f38372fb0380 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:34.512038 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 357/715] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:31:34.535948 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dbe56-12bf-4852-82af-245b3d662fdd None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:34.545751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:34.546973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.547408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.547877 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.560066 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:31:34.568610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:34.570296 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:31:34.571690 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:34.574176 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 359/716] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:31:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:34.583862 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:34.619286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:34.646367 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dbe56-12bf-4852-82af-245b3d662fdd None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:34.660156 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:34.687950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:34.688898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.689287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.689672 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] PATH_INFO: `/v3/services/image` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.690430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:34.691939 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:34.704709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:34.705930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 15:31:34.706903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:34.707700 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82591f0-e591-4100-a332-7e0e32d01653 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:34.708357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 358/717] 10.222.0.94 () {56 vars in 1105 bytes} [Fri Jul 15 15:31:34 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:34.713539 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:34.746961 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:34.747955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.748253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.748539 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.749310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:34.749626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:34.751175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:34.762076 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 360/718] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:34.767581 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:34.884649 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f0198-d453-4718-93cd-f05b0398899e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:34.901115 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:34.924393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:34.925193 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:34.925529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:34.925811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:34.939378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:34.940895 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:34.963431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:34.964391 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:34.965270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:34.965270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:34.965270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:34.965270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:34.966771 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 361/719] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:34.968138 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.012794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7b32a-46ba-4d70-be7c-f7079f36f5d7 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.048561 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.049598 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.050086 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.050629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.051534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:35.052071 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.053667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.063431 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 359/720] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:35.064636 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.068430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:35.085915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670b9c2-8c60-4e28-ac14-24c5bd88a193 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.124577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.125577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.126096 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.126548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.127474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:35.127974 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.130013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.147915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 362/721] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:35.151009 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.168946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568324eb-3034-451c-bb15-535bebb960b6 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.181357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:35.206208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.207025 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.207429 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.207963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.208735 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] RBAC: Adding query filter params (type=image) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:35.209314 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.210778 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.216268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 360/722] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:35.225723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.268098 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621bc92-15e2-45ed-b834-82dbdea58523 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.308236 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:35.313013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.314031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.314470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.314901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.323489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.325439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:35.342302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:35.343370 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 15:31:35.344438 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:35.344989 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc6f12-5ad9-4613-bca6-36afdf935e68 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.351491 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 363/723] 10.222.0.94 () {56 vars in 1093 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:35.353458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.381366 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb94f8f-b1e3-4c19-a6cb-51c111fa256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.382196 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94f8f-b1e3-4c19-a6cb-51c111fa256f None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.382548 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94f8f-b1e3-4c19-a6cb-51c111fa256f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.382903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb94f8f-b1e3-4c19-a6cb-51c111fa256f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.383717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb94f8f-b1e3-4c19-a6cb-51c111fa256f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.385171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb94f8f-b1e3-4c19-a6cb-51c111fa256f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.415862 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 361/724] 10.222.0.94 () {60 vars in 1144 bytes} [Fri Jul 15 15:31:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:31:35.426428 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff106b64-a134-4fcc-9aea-f25f5f3ee4ac None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.427057 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff106b64-a134-4fcc-9aea-f25f5f3ee4ac None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.427646 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff106b64-a134-4fcc-9aea-f25f5f3ee4ac None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.431494 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 362/725] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:35.437015 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988c99-e976-499d-9e85-596e26ab87fb None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.437357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988c99-e976-499d-9e85-596e26ab87fb None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.437831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44988c99-e976-499d-9e85-596e26ab87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.459570 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:35.460149 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-44988c99-e976-499d-9e85-596e26ab87fb None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:35.461890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-44988c99-e976-499d-9e85-596e26ab87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:35.479782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e690cb-1b0a-423b-ad13-8ef9ae5aae71 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.531709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.532496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.532851 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.533211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.534130 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:35.534589 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.536335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.555571 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 363/726] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:35 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:31:35.570839 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 364/727] 10.222.0.94 () {56 vars in 1133 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:35.572641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44988c99-e976-499d-9e85-596e26ab87fb None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.579767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.640789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:35.698518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44988c99-e976-499d-9e85-596e26ab87fb None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.701698 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662c68-3cb1-497e-8602-d1ab14bf6108 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.745871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.746841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.747232 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.747586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.747776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.748510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.748716 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.749133 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.749546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.750332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:35.767410 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:35.768610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 15:31:35.769625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:35.770873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 365/728] 10.222.0.94 () {56 vars in 1129 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:35.778676 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.784605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:35.836049 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.837958 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.906231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:35.930921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d85c1c-2e84-4fe7-a279-802e7ea59e61 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:35.957332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 364/729] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:31:35.968707 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:35.983354 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389b41b-1729-424a-a7f8-17acecd8d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:35.984060 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b41b-1729-424a-a7f8-17acecd8d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.984722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b41b-1729-424a-a7f8-17acecd8d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.985015 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b41b-1729-424a-a7f8-17acecd8d6b3 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.985770 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389b41b-1729-424a-a7f8-17acecd8d6b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:35.986082 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389b41b-1729-424a-a7f8-17acecd8d6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:35.987884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389b41b-1729-424a-a7f8-17acecd8d6b3 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:35.992633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 366/730] 10.222.0.94 () {56 vars in 1124 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:35.994057 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e700b9-d6ba-4fc2-9905-da8d0821f5c9 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:35.994359 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e700b9-d6ba-4fc2-9905-da8d0821f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:35.994641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e700b9-d6ba-4fc2-9905-da8d0821f5c9 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:35.996187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 367/731] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:35.998250 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e700b9-d6ba-4fc2-9905-da8d0821f5c9 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.075146 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:36.084340 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b81eb-e793-4ff4-b392-941fc652bd8a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.113985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e700b9-d6ba-4fc2-9905-da8d0821f5c9 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.121449 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e90964-66e9-48db-9983-ed17bd4a8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.122245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e90964-66e9-48db-9983-ed17bd4a8e35 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.122527 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e90964-66e9-48db-9983-ed17bd4a8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.122803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e90964-66e9-48db-9983-ed17bd4a8e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.133264 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e90964-66e9-48db-9983-ed17bd4a8e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.134943 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e90964-66e9-48db-9983-ed17bd4a8e35 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.152019 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.152925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-b9e90964-66e9-48db-9983-ed17bd4a8e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:36.153034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:36.153828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:36.154750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:36.154750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:36.154750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:36.154750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:36.154750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 365/732] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:36.155433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607f411-8038-442c-8778-93601077a389 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.155722 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607f411-8038-442c-8778-93601077a389 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.156021 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607f411-8038-442c-8778-93601077a389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.156180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.156658 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.157664 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:36.158034 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.159476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.169697 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 368/733] 10.222.0.94 () {56 vars in 1124 bytes} [Fri Jul 15 15:31:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:36.169697 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.169980 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:36.177140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-1607f411-8038-442c-8778-93601077a389 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:36.178435 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-1607f411-8038-442c-8778-93601077a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:36.260393 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 366/734] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:36 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:36.261403 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607f411-8038-442c-8778-93601077a389 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.284946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bbbfd-ccd2-4029-8a2d-4c5d5dbffd35 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.316781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:36.323843 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.324515 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.324805 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.325080 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.325851 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:36.326103 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.327460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.339864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 369/735] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:36.340676 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.384983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607f411-8038-442c-8778-93601077a389 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.420646 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.421313 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.421600 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.421882 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.422624 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.424016 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.428100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:36.442538 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 367/736] 10.222.0.94 () {60 vars in 1144 bytes} [Fri Jul 15 15:31:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:36.448397 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451d0eb-5ea0-4035-9f78-fe1970956133 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.452818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.500156 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.501061 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.501347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.501676 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] PATH_INFO: `/v3/services/network` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.502392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.504538 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:36.518224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:36.519304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 15:31:36.520169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:36.524305 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 370/737] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:36 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:36.526125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.592143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:36.608224 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3ed7f-5f6e-4b5a-9d42-ec72eff3299a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.652580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.653398 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.653693 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.653969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.662125 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.664394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.666080 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67996731-7218-46d4-8d52-a599700e0042 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:36.681266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:36.682268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:36.683189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 368/738] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:36.689965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.712524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.713378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.713762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.714141 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.715069 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] RBAC: Adding query filter params (name=network) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:36.715448 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.717202 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.723044 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 371/739] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:36.728757 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.755420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:36.831661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7514ce-12fb-420b-8f1e-0948956bb3f9 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.848988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825775-d516-47c8-ad8e-27c01d0f3363 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:36.866243 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:36.883108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.884127 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.884518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.885243 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.886448 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:36.886824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.888563 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.890375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:36.891209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:36.891646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:36.892165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:36.893070 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] RBAC: Adding query filter params (type=network) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:36.893560 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:36.895106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:36.900923 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 372/740] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:36.907175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 369/741] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:31:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:36.908343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:36.912402 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:37.048888 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95677bc6-8f9f-4348-ac40-5f7d09cbbb6a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:37.049126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9615-4395-483a-be0f-344eb8926cf4 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:37.068902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:37.092225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdc5e4-3300-4e1a-b7b0-835e8e839a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:37.093182 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdc5e4-3300-4e1a-b7b0-835e8e839a18 None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:37.093541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdc5e4-3300-4e1a-b7b0-835e8e839a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:37.093981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdc5e4-3300-4e1a-b7b0-835e8e839a18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:37.094816 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdc5e4-3300-4e1a-b7b0-835e8e839a18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:37.096518 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdc5e4-3300-4e1a-b7b0-835e8e839a18 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:37.096869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd12c8-4225-477d-a4e9-1d0fdb6b2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:37.097679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd12c8-4225-477d-a4e9-1d0fdb6b2204 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:37.098126 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd12c8-4225-477d-a4e9-1d0fdb6b2204 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:37.098544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd12c8-4225-477d-a4e9-1d0fdb6b2204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:37.099558 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd12c8-4225-477d-a4e9-1d0fdb6b2204 None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=1cebf7555312469984252513f450b58f) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:37.100060 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd12c8-4225-477d-a4e9-1d0fdb6b2204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:37.102381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd12c8-4225-477d-a4e9-1d0fdb6b2204 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:37.110358 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 370/742] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:31:36 2022] GET /identity/v3/role_assignments?user.id=1cebf7555312469984252513f450b58f&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=8442e7332b934407beff8c3564575b62 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:37.126524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 373/743] 10.222.0.94 () {60 vars in 1144 bytes} [Fri Jul 15 15:31:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:37.809323 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a162-7076-4460-8e53-d0abb69207d3 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:37.809867 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a162-7076-4460-8e53-d0abb69207d3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:37.810137 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9a162-7076-4460-8e53-d0abb69207d3 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:37.811375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 371/744] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:37.816577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fce0e9-3760-498c-809e-cb5c6db147cd None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:37.816972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fce0e9-3760-498c-809e-cb5c6db147cd None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:37.817139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fce0e9-3760-498c-809e-cb5c6db147cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:37.835299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-a3fce0e9-3760-498c-809e-cb5c6db147cd None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:37.836520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-a3fce0e9-3760-498c-809e-cb5c6db147cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:37.866128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:37.924183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 374/745] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:37 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:37.948270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a162-7076-4460-8e53-d0abb69207d3 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:38.056000 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9a162-7076-4460-8e53-d0abb69207d3 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:38.088489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:38.089067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:38.089354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:38.089634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:38.134696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:38.158329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:38.159789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:38.258173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 372/746] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:31:37 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:31:38.265920 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fce0e9-3760-498c-809e-cb5c6db147cd None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:38.369220 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fce0e9-3760-498c-809e-cb5c6db147cd None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:38.404217 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316522-36ca-44c2-b2af-f9c4a651033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:38.405037 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316522-36ca-44c2-b2af-f9c4a651033c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:38.405335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316522-36ca-44c2-b2af-f9c4a651033c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:38.405604 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316522-36ca-44c2-b2af-f9c4a651033c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:38.416757 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316522-36ca-44c2-b2af-f9c4a651033c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:38.418223 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316522-36ca-44c2-b2af-f9c4a651033c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-ad316522-36ca-44c2-b2af-f9c4a651033c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:31:38.435769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:38.436692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:38.437740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:31:38.437740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:31:38.437740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:31:38.437740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:38.437740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 375/747] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:38.442717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:38.519581 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:38.544089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906b320-092f-4766-b70b-4e700b44d7e4 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:38.578067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d81922-6fcb-4012-99f8-d4624f2cee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:38.578728 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81922-6fcb-4012-99f8-d4624f2cee21 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:38.579012 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81922-6fcb-4012-99f8-d4624f2cee21 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:38.579291 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d81922-6fcb-4012-99f8-d4624f2cee21 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:38.580033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d81922-6fcb-4012-99f8-d4624f2cee21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:38.580340 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d81922-6fcb-4012-99f8-d4624f2cee21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:38.581688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d81922-6fcb-4012-99f8-d4624f2cee21 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:38.599779 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 373/748] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:38.780563 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898d1a-f785-4f4d-831a-113dc457c2da None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:38.780852 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898d1a-f785-4f4d-831a-113dc457c2da None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:38.781209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898d1a-f785-4f4d-831a-113dc457c2da None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:38.782657 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 376/749] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:38.787714 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40816ee6-4b41-4766-94c1-816ba159baa3 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:38.788613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40816ee6-4b41-4766-94c1-816ba159baa3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:38.788898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40816ee6-4b41-4766-94c1-816ba159baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:38.806739 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-40816ee6-4b41-4766-94c1-816ba159baa3 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:38.807989 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-40816ee6-4b41-4766-94c1-816ba159baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:38.884737 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 374/750] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:38 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:31:38.908559 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c898d1a-f785-4f4d-831a-113dc457c2da None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:38.924393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:39.013612 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c898d1a-f785-4f4d-831a-113dc457c2da None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:39.048144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:39.048865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:39.049151 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:39.049429 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:39.050083 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:39.051455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:39.065078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:39.066219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:39.067050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:39.071955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 377/751] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:39.073192 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40816ee6-4b41-4766-94c1-816ba159baa3 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:39.137496 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:39.171730 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40816ee6-4b41-4766-94c1-816ba159baa3 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:39.205489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1836a4-634c-4b16-af59-e20ffeca2032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:39.206150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1836a4-634c-4b16-af59-e20ffeca2032 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:39.206437 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1836a4-634c-4b16-af59-e20ffeca2032 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:39.206714 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1836a4-634c-4b16-af59-e20ffeca2032 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:39.207416 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1836a4-634c-4b16-af59-e20ffeca2032 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:39.207722 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1836a4-634c-4b16-af59-e20ffeca2032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:39.209108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1836a4-634c-4b16-af59-e20ffeca2032 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:39.213534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 375/752] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:39.219362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:39.299845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:39.324345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3752c3-3e45-458b-a383-bb95d8c73953 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:39.357443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dd7e8-8111-43fa-916c-2264885f7a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:39.358108 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dd7e8-8111-43fa-916c-2264885f7a6b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:39.358567 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dd7e8-8111-43fa-916c-2264885f7a6b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:39.358730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dd7e8-8111-43fa-916c-2264885f7a6b None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:39.359377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dd7e8-8111-43fa-916c-2264885f7a6b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:39.359687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dd7e8-8111-43fa-916c-2264885f7a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:39.361093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dd7e8-8111-43fa-916c-2264885f7a6b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:39.365574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 378/753] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:39.454142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bdcdb-ca71-4b40-ab09-db63948d46d7 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:39.454433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bdcdb-ca71-4b40-ab09-db63948d46d7 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:39.454708 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bdcdb-ca71-4b40-ab09-db63948d46d7 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:39.456146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 376/754] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:39.461951 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3925d-846b-4768-b508-892a59e09b91 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:39.462244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3925d-846b-4768-b508-892a59e09b91 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:39.462529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3925d-846b-4768-b508-892a59e09b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:39.481201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-29c3925d-846b-4768-b508-892a59e09b91 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:39.482676 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-29c3925d-846b-4768-b508-892a59e09b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:39.673921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 379/755] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:39 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:39.697077 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bdcdb-ca71-4b40-ab09-db63948d46d7 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:39.798260 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bdcdb-ca71-4b40-ab09-db63948d46d7 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:39.827392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:39.834907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:39.835748 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:39.836065 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:39.836344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:39.837000 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:39.838363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:39.850609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:39.851800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:39.852946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:39.856047 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 377/756] 10.222.0.94 () {56 vars in 1132 bytes} [Fri Jul 15 15:31:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:39.857611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3925d-846b-4768-b508-892a59e09b91 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:39.927634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:39.958480 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3925d-846b-4768-b508-892a59e09b91 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:39.994070 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f75e3-cdcd-4f55-9d64-533d4bad261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:39.994735 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f75e3-cdcd-4f55-9d64-533d4bad261b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:39.995023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f75e3-cdcd-4f55-9d64-533d4bad261b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:39.995302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f75e3-cdcd-4f55-9d64-533d4bad261b None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:39.996050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f75e3-cdcd-4f55-9d64-533d4bad261b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:39.996363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f75e3-cdcd-4f55-9d64-533d4bad261b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:39.997735 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f75e3-cdcd-4f55-9d64-533d4bad261b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:40.002224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 380/757] 10.222.0.94 () {56 vars in 1126 bytes} [Fri Jul 15 15:31:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:40.008988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:40.109099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cbb5c-2594-45b0-afe6-314c7ed910e6 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:40.142998 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f4c1e-a504-43b7-85ad-7ad0243988d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:40.143662 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4c1e-a504-43b7-85ad-7ad0243988d9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:40.143971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4c1e-a504-43b7-85ad-7ad0243988d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:40.144252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4c1e-a504-43b7-85ad-7ad0243988d9 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:40.144955 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f4c1e-a504-43b7-85ad-7ad0243988d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:40.145262 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f4c1e-a504-43b7-85ad-7ad0243988d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:40.146620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f4c1e-a504-43b7-85ad-7ad0243988d9 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:40.150951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 378/758] 10.222.0.94 () {56 vars in 1126 bytes} [Fri Jul 15 15:31:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:41.562414 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971b591-dcdf-4508-9ffb-3c89f920ff5f None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:41.562966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971b591-dcdf-4508-9ffb-3c89f920ff5f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:41.562966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971b591-dcdf-4508-9ffb-3c89f920ff5f None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:41.564361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 381/759] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:41.570262 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4e607-348d-433b-b304-bbd4458ae4cb None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:41.570654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4e607-348d-433b-b304-bbd4458ae4cb None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:41.570818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4e607-348d-433b-b304-bbd4458ae4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:41.587047 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-25a4e607-348d-433b-b304-bbd4458ae4cb None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:41.588247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-25a4e607-348d-433b-b304-bbd4458ae4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:41.640202 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:41.653932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 379/760] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:41 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:41.677117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971b591-dcdf-4508-9ffb-3c89f920ff5f None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:41.775640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971b591-dcdf-4508-9ffb-3c89f920ff5f None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:41.808277 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb6ebe-5874-4d18-8634-8bb18d11cefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:41.808931 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb6ebe-5874-4d18-8634-8bb18d11cefa None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:41.809211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb6ebe-5874-4d18-8634-8bb18d11cefa None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:41.809526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb6ebe-5874-4d18-8634-8bb18d11cefa None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:41.810270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb6ebe-5874-4d18-8634-8bb18d11cefa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:41.811626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb6ebe-5874-4d18-8634-8bb18d11cefa None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:41.814632 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:41.827773 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 382/761] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:31:41 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:42.394903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb8e54-1a0f-4a6a-a21a-bfa275dd30ea None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:42.395200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb8e54-1a0f-4a6a-a21a-bfa275dd30ea None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:42.395488 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb8e54-1a0f-4a6a-a21a-bfa275dd30ea None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:42.396901 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 380/762] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:42.405177 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c466-6c2a-400d-a6f8-362f6d6d079c None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:42.405470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c466-6c2a-400d-a6f8-362f6d6d079c None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:42.405751 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44c466-6c2a-400d-a6f8-362f6d6d079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:42.423192 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-1c44c466-6c2a-400d-a6f8-362f6d6d079c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:42.424412 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-1c44c466-6c2a-400d-a6f8-362f6d6d079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:42.495053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 383/763] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:42 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:42.518878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb8e54-1a0f-4a6a-a21a-bfa275dd30ea None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:42.620698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb8e54-1a0f-4a6a-a21a-bfa275dd30ea None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:42.654184 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b57dd-d9df-421c-a075-1fcbeb08cbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:42.654778 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b57dd-d9df-421c-a075-1fcbeb08cbfb None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:42.655066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b57dd-d9df-421c-a075-1fcbeb08cbfb None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:42.655345 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b57dd-d9df-421c-a075-1fcbeb08cbfb None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:42.656111 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b57dd-d9df-421c-a075-1fcbeb08cbfb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:42.657476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b57dd-d9df-421c-a075-1fcbeb08cbfb None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:42.672032 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 381/764] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:31:42 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:44.067873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde15e-3207-466d-ae7e-ee564eb36599 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.068444 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde15e-3207-466d-ae7e-ee564eb36599 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.068543 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde15e-3207-466d-ae7e-ee564eb36599 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.070146 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 384/765] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:44.075568 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ef08-8f2c-4eba-a484-eeda42a37b3d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.076023 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ef08-8f2c-4eba-a484-eeda42a37b3d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.076179 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ef08-8f2c-4eba-a484-eeda42a37b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.092696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-a3f5ef08-8f2c-4eba-a484-eeda42a37b3d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:44.093889 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-a3f5ef08-8f2c-4eba-a484-eeda42a37b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:44.138320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:44.169091 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 382/766] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:44.192477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dde15e-3207-466d-ae7e-ee564eb36599 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:44.296712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dde15e-3207-466d-ae7e-ee564eb36599 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:44.320489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:44.331583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:44.332407 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.332691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.332968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.333625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:44.334990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:44.346636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:44.347884 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:44.349187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:44.351886 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 385/767] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:44.353667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ef08-8f2c-4eba-a484-eeda42a37b3d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:44.452355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ef08-8f2c-4eba-a484-eeda42a37b3d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:44.484921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:44.485586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.485870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.486147 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.486846 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:44.487151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:44.488552 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:44.493732 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 383/768] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:44.499465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:44.597803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc155-339b-4421-a599-410cf29bc875 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:44.632722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:44.633372 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.633657 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.633934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.634639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:44.634946 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:44.636350 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:44.641037 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 386/769] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:44.646844 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:44.687067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:44.749636 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad21c7-20f8-4149-9395-1c68d3bac526 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:44.784014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b124c9-9343-48aa-a205-0a9dc4a39d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:44.784677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b124c9-9343-48aa-a205-0a9dc4a39d05 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.784961 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b124c9-9343-48aa-a205-0a9dc4a39d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.785236 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b124c9-9343-48aa-a205-0a9dc4a39d05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.786015 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b124c9-9343-48aa-a205-0a9dc4a39d05 None admin] RBAC: Adding query filter params (interface=public, service_id=40fae6ce30e0457b8a20db039850e212, region_id=RegionOne) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:44.786327 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b124c9-9343-48aa-a205-0a9dc4a39d05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:44.788281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b124c9-9343-48aa-a205-0a9dc4a39d05 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:44.793233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 384/770] 10.222.0.94 () {56 vars in 1251 bytes} [Fri Jul 15 15:31:44 2022] GET /identity/v3/endpoints?service_id=40fae6ce30e0457b8a20db039850e212&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:44.799175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:44.848893 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:44.882417 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6feb-de42-4719-8d7c-1572670bf964 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.882704 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6feb-de42-4719-8d7c-1572670bf964 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.882984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6feb-de42-4719-8d7c-1572670bf964 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.884367 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 385/771] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:44.889148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625fb08-fe3b-48ac-9c47-1efd02b32258 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.889431 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625fb08-fe3b-48ac-9c47-1efd02b32258 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.889708 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625fb08-fe3b-48ac-9c47-1efd02b32258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.903375 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f55c-c058-45e0-85ef-bb8646f1907d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:44.905765 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-b625fb08-fe3b-48ac-9c47-1efd02b32258 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:44.906953 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-b625fb08-fe3b-48ac-9c47-1efd02b32258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:44.939602 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:44.940675 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:44.941178 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:44.941687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:44.942921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:44.945427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:44.951582 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 387/772] 10.222.0.94 () {56 vars in 1087 bytes} [Fri Jul 15 15:31:44 2022] GET /identity/v3/services => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:31:44.977360 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 386/773] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:31:45.001880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:45.106366 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b5ac8-1168-4650-838a-0acedeba5144 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:45.121469 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:45.142480 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:45.143245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:45.143531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:45.143835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:45.144495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:45.145865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:45.158524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:45.159666 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:45.160693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 388/774] 10.222.0.94 () {56 vars in 1132 bytes} [Fri Jul 15 15:31:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:45.166409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625fb08-fe3b-48ac-9c47-1efd02b32258 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:45.196461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:45.268352 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625fb08-fe3b-48ac-9c47-1efd02b32258 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:45.303763 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:45.304449 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:45.304738 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:45.305021 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:45.305727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:45.306039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:45.307413 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:45.312211 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 387/775] 10.222.0.94 () {56 vars in 1126 bytes} [Fri Jul 15 15:31:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:45.317858 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:45.418533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e695b-7fd4-477e-a8f4-bd899d6f8409 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:45.452414 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:45.453072 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:45.453357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:45.453635 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:45.454334 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:45.454640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:45.456094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:45.460981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 389/776] 10.222.0.94 () {56 vars in 1126 bytes} [Fri Jul 15 15:31:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:45.467032 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:45.560506 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:45.567278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71da547-e31f-414b-b5d1-277c8455b4e1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:45.611759 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d832aa-c5fa-4ede-b5e5-f0848873d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:45.612443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d832aa-c5fa-4ede-b5e5-f0848873d264 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:45.612727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d832aa-c5fa-4ede-b5e5-f0848873d264 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:45.613004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d832aa-c5fa-4ede-b5e5-f0848873d264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:45.613788 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d832aa-c5fa-4ede-b5e5-f0848873d264 None admin] RBAC: Adding query filter params (interface=public, service_id=9ca11b5b8e314531aa8070d7c21108b7, region_id=RegionOne) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:45.614102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d832aa-c5fa-4ede-b5e5-f0848873d264 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:45.615464 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d832aa-c5fa-4ede-b5e5-f0848873d264 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:45.620661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 388/777] 10.222.0.94 () {56 vars in 1251 bytes} [Fri Jul 15 15:31:45 2022] GET /identity/v3/endpoints?service_id=9ca11b5b8e314531aa8070d7c21108b7&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:45.626287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:45.674513 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:45.732498 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a6503-5e6f-4f1a-b142-4ebb62187163 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:45.765063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb855ce-c6e3-4459-a6d4-16791b33771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:45.765716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb855ce-c6e3-4459-a6d4-16791b33771b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:45.766003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb855ce-c6e3-4459-a6d4-16791b33771b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:45.766281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb855ce-c6e3-4459-a6d4-16791b33771b None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:45.766955 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb855ce-c6e3-4459-a6d4-16791b33771b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:45.768346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb855ce-c6e3-4459-a6d4-16791b33771b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:45.774637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 390/778] 10.222.0.94 () {56 vars in 1087 bytes} [Fri Jul 15 15:31:45 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:31:47.199580 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77f5e-0fe3-4627-ade5-6d1fbad9a6ff None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:47.200137 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77f5e-0fe3-4627-ade5-6d1fbad9a6ff None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:47.200225 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77f5e-0fe3-4627-ade5-6d1fbad9a6ff None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:47.201535 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 389/779] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:47.206779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fe93b-6c62-4173-8a3c-03c07a78a6cc None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:47.207222 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fe93b-6c62-4173-8a3c-03c07a78a6cc None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:47.207354 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fe93b-6c62-4173-8a3c-03c07a78a6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:47.223803 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-878fe93b-6c62-4173-8a3c-03c07a78a6cc None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:47.225580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-878fe93b-6c62-4173-8a3c-03c07a78a6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:47.293092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 391/780] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:47 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:47.316737 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77f5e-0fe3-4627-ade5-6d1fbad9a6ff None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:47.416481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77f5e-0fe3-4627-ade5-6d1fbad9a6ff None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:47.450787 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:47.451584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:47.451903 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:47.452183 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:47.452833 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:47.454190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:47.466369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:47.467550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:47.468432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 390/781] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:47.473428 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fe93b-6c62-4173-8a3c-03c07a78a6cc None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:47.507633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:47.570487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fe93b-6c62-4173-8a3c-03c07a78a6cc None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:47.605117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:47.605811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:47.606096 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:47.606373 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:47.607072 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:47.607378 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:47.608785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:47.613526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 392/782] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:47.619011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:47.647460 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:47.720173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c44fc-e214-4924-a398-2f8e3f701065 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:47.751901 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cb34e-20e6-4e13-aaf6-0132dde97c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:47.752553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cb34e-20e6-4e13-aaf6-0132dde97c4e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:47.752835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cb34e-20e6-4e13-aaf6-0132dde97c4e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:47.753110 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cb34e-20e6-4e13-aaf6-0132dde97c4e None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:47.754071 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cb34e-20e6-4e13-aaf6-0132dde97c4e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:47.754371 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cb34e-20e6-4e13-aaf6-0132dde97c4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:47.755753 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cb34e-20e6-4e13-aaf6-0132dde97c4e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:47.765893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 391/783] 10.222.0.94 () {56 vars in 1114 bytes} [Fri Jul 15 15:31:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:47.766811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:47.866038 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:47.869272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e72a-6403-4b82-b2f6-67908f0ed891 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:47.903628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7c15f-5ee0-448d-8659-d65505d44e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:47.904302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7c15f-5ee0-448d-8659-d65505d44e7d None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:47.904584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7c15f-5ee0-448d-8659-d65505d44e7d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:47.904857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7c15f-5ee0-448d-8659-d65505d44e7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:47.905593 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7c15f-5ee0-448d-8659-d65505d44e7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:47.906939 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7c15f-5ee0-448d-8659-d65505d44e7d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:47.925059 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 393/784] 10.222.0.94 () {60 vars in 1144 bytes} [Fri Jul 15 15:31:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:47.992032 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a436-b956-4151-a112-aa93daa5393d None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:47.992326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a436-b956-4151-a112-aa93daa5393d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:47.992613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150a436-b956-4151-a112-aa93daa5393d None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:47.994008 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 392/785] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:48.000176 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf2f61-be52-4133-8291-fac67d0e32dd None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:48.000470 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf2f61-be52-4133-8291-fac67d0e32dd None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:48.000753 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf2f61-be52-4133-8291-fac67d0e32dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:48.019584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-01bf2f61-be52-4133-8291-fac67d0e32dd None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:48.020764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-01bf2f61-be52-4133-8291-fac67d0e32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:48.095823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 394/786] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:47 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:48.120066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150a436-b956-4151-a112-aa93daa5393d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:48.211530 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:48.224446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150a436-b956-4151-a112-aa93daa5393d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:48.259549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:48.260415 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:48.260700 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:48.260975 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:48.261623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:48.262980 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:48.275105 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:48.276044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 15:31:48.276916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:48.278272 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 393/787] 10.222.0.94 () {56 vars in 1132 bytes} [Fri Jul 15 15:31:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:48.282184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf2f61-be52-4133-8291-fac67d0e32dd None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:48.361003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:48.380844 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf2f61-be52-4133-8291-fac67d0e32dd None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:48.414319 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:48.414979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:48.415266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:48.415545 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:48.416287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:48.416596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:48.417956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:48.422539 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 395/788] 10.222.0.94 () {56 vars in 1126 bytes} [Fri Jul 15 15:31:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:48.428876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:48.526452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc89508-2ef3-4172-a705-0ad1cb10684d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:48.560066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724d01-9e8a-4143-ba28-befcc0df9b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:48.560731 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724d01-9e8a-4143-ba28-befcc0df9b77 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:48.561020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724d01-9e8a-4143-ba28-befcc0df9b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:48.561301 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724d01-9e8a-4143-ba28-befcc0df9b77 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:48.562005 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724d01-9e8a-4143-ba28-befcc0df9b77 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:48.562316 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724d01-9e8a-4143-ba28-befcc0df9b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:48.563687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724d01-9e8a-4143-ba28-befcc0df9b77 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:48.568451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 394/789] 10.222.0.94 () {56 vars in 1126 bytes} [Fri Jul 15 15:31:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:48.574258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:48.674712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b1c6-3314-4152-bc8c-a10c46c1cba5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:48.708450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7433c02-01f6-4d3f-9d89-4a278c8a6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:48.709107 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433c02-01f6-4d3f-9d89-4a278c8a6e45 None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:48.709423 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433c02-01f6-4d3f-9d89-4a278c8a6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:48.709705 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7433c02-01f6-4d3f-9d89-4a278c8a6e45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:48.710455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7433c02-01f6-4d3f-9d89-4a278c8a6e45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:48.711849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7433c02-01f6-4d3f-9d89-4a278c8a6e45 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:48.729918 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 396/790] 10.222.0.94 () {60 vars in 1144 bytes} [Fri Jul 15 15:31:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:50.192790 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881909-fd76-476a-b373-b1e1f796ad54 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:50.193332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881909-fd76-476a-b373-b1e1f796ad54 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:50.193419 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881909-fd76-476a-b373-b1e1f796ad54 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:50.194853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 395/791] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:50.200144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e84e-2a0a-470c-916f-3762c6552c03 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:50.200583 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e84e-2a0a-470c-916f-3762c6552c03 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:50.200708 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e84e-2a0a-470c-916f-3762c6552c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:50.205669 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:50.218688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-2444e84e-2a0a-470c-916f-3762c6552c03 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:50.219910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-2444e84e-2a0a-470c-916f-3762c6552c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:50.290678 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 397/792] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:50.314866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881909-fd76-476a-b373-b1e1f796ad54 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:50.333076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:50.414854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881909-fd76-476a-b373-b1e1f796ad54 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:50.447890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:50.448545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:50.449002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:50.449285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:50.450075 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:50.451505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:50.452895 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING keystone.server.flask.common [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 15:31:50.469866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.sql.core [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 15:31:50.469866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 15:31:50.469866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [parameters: {'id': '56f766ccf50e4ab9b7cdcae144c998c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 15:31:50.469866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87247) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 56f766ccf50e4ab9b7cdcae144c998c8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 56f766ccf50e4ab9b7cdcae144c998c8. Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:31:50.488337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result.read() Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 15:31:50.489381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application yield resource Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise self.value Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application session.commit() Jul 15 15:31:50.495847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.session.flush() Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application compat.raise_( Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 15:31:50.496972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 15:31:50.498019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result.read() Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:31:50.498856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [parameters: {'id': '56f766ccf50e4ab9b7cdcae144c998c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:50.499969 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:50.500950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 56f766ccf50e4ab9b7cdcae144c998c8. Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:50.502039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 396/793] 10.222.0.94 () {60 vars in 1140 bytes} [Fri Jul 15 15:31:50 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:50.502693 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444e84e-2a0a-470c-916f-3762c6552c03 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:50.599351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444e84e-2a0a-470c-916f-3762c6552c03 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:50.625791 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:50.635924 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27473a2e-569f-4090-b780-5659ce7c3d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:50.636719 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473a2e-569f-4090-b780-5659ce7c3d3c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:50.637005 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473a2e-569f-4090-b780-5659ce7c3d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:50.637288 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473a2e-569f-4090-b780-5659ce7c3d3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:50.643871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27473a2e-569f-4090-b780-5659ce7c3d3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:50.645293 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27473a2e-569f-4090-b780-5659ce7c3d3c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-27473a2e-569f-4090-b780-5659ce7c3d3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:31:50.658736 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:50.659626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:50.660548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 398/794] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:50.666601 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:50.736699 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:50.768587 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a36be-ef4f-4a49-bf00-bbdf935d5cb0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:50.801597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ce940-0eb1-4bd4-9522-7cc1a2a0385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:50.802260 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce940-0eb1-4bd4-9522-7cc1a2a0385b None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:50.802552 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce940-0eb1-4bd4-9522-7cc1a2a0385b None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:50.803287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce940-0eb1-4bd4-9522-7cc1a2a0385b None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:50.803962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce940-0eb1-4bd4-9522-7cc1a2a0385b None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:50.803962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce940-0eb1-4bd4-9522-7cc1a2a0385b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:50.805608 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce940-0eb1-4bd4-9522-7cc1a2a0385b None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:50.829598 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 397/795] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:50.979952 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57f1c-9331-4536-a122-c54957aac7d8 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:50.980247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57f1c-9331-4536-a122-c54957aac7d8 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:50.980528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57f1c-9331-4536-a122-c54957aac7d8 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:50.982426 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 399/796] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:50.988322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65731d1-e619-4474-becf-efa34a37e72c None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:50.988623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65731d1-e619-4474-becf-efa34a37e72c None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:50.988910 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65731d1-e619-4474-becf-efa34a37e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:51.007043 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e65731d1-e619-4474-becf-efa34a37e72c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:51.008643 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e65731d1-e619-4474-becf-efa34a37e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:51.076179 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 398/797] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:51.098804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57f1c-9331-4536-a122-c54957aac7d8 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:51.201069 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57f1c-9331-4536-a122-c54957aac7d8 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:51.236075 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:51.236872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:51.237159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:51.237439 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:51.238096 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:51.239469 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:51.251778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:51.252945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:51.254201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 400/798] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:51.259857 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65731d1-e619-4474-becf-efa34a37e72c None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:51.319241 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:51.356940 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65731d1-e619-4474-becf-efa34a37e72c None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:51.391498 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d70ca9-063b-4628-991d-0eb03c853e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:51.392208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70ca9-063b-4628-991d-0eb03c853e7b None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:51.392524 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70ca9-063b-4628-991d-0eb03c853e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:51.392806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d70ca9-063b-4628-991d-0eb03c853e7b None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:51.393516 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d70ca9-063b-4628-991d-0eb03c853e7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:51.393827 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d70ca9-063b-4628-991d-0eb03c853e7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:51.395194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d70ca9-063b-4628-991d-0eb03c853e7b None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:51.399953 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 399/799] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:51.405687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:51.457078 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:51.505261 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3f80-a924-4f86-a5ae-5691892b4fd0 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:51.537069 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119a0c2-e64b-4b8b-b778-0b46a3fa3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:51.538256 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119a0c2-e64b-4b8b-b778-0b46a3fa3266 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:51.538539 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119a0c2-e64b-4b8b-b778-0b46a3fa3266 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:51.538819 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119a0c2-e64b-4b8b-b778-0b46a3fa3266 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:51.539520 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119a0c2-e64b-4b8b-b778-0b46a3fa3266 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:51.539996 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119a0c2-e64b-4b8b-b778-0b46a3fa3266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:51.541368 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119a0c2-e64b-4b8b-b778-0b46a3fa3266 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:51.545926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 401/800] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:53.129799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c202a-46c6-48f8-a241-66b1e9695c7b None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:53.130366 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c202a-46c6-48f8-a241-66b1e9695c7b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:53.130474 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c202a-46c6-48f8-a241-66b1e9695c7b None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:53.132406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 400/801] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:53.137620 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884c71-8a39-412b-8d8a-dcbd66d09f26 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:53.138030 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884c71-8a39-412b-8d8a-dcbd66d09f26 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:53.138186 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884c71-8a39-412b-8d8a-dcbd66d09f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:53.155299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-fd884c71-8a39-412b-8d8a-dcbd66d09f26 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:53.156512 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-fd884c71-8a39-412b-8d8a-dcbd66d09f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:53.229122 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 402/802] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:53.254671 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c202a-46c6-48f8-a241-66b1e9695c7b None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:53.355019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c202a-46c6-48f8-a241-66b1e9695c7b None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:53.380381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:53.389816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:53.390491 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:53.390780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:53.391063 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:53.391802 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:53.393239 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:53.405902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.sql.core [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 15:31:53.405902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 15:31:53.405902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [parameters: {'user_id': '497c4255b6d84897ac2cd2780ecf95da', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 15:31:53.405902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87247) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result.read() Jul 15 15:31:53.413446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:31:53.414513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application yield resource Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application next(self.gen) Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise self.value Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application session.commit() Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 15:31:53.415682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.session.flush() Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application compat.raise_( Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 15:31:53.416780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 15:31:53.417854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application conn.query(q) Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application result.read() Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 15:31:53.418872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [parameters: {'user_id': '497c4255b6d84897ac2cd2780ecf95da', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:53.420207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 15:31:53.421278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 15:31:53.422401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 15:31:53.422401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 15:31:53.422401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 15:31:53.422401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 15:31:53.422401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 15:31:53.422401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:53.422401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 401/803] 10.222.0.94 () {60 vars in 1131 bytes} [Fri Jul 15 15:31:53 2022] POST /identity/v3/users => generated 160 bytes in 165 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:53.422854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884c71-8a39-412b-8d8a-dcbd66d09f26 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:53.468954 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:53.522944 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884c71-8a39-412b-8d8a-dcbd66d09f26 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:53.557369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eeb28-e85b-44d2-8e2f-f5bbbf409adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:53.558169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eeb28-e85b-44d2-8e2f-f5bbbf409adf None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:53.558459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eeb28-e85b-44d2-8e2f-f5bbbf409adf None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:53.558740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eeb28-e85b-44d2-8e2f-f5bbbf409adf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:53.565747 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eeb28-e85b-44d2-8e2f-f5bbbf409adf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:53.567195 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eeb28-e85b-44d2-8e2f-f5bbbf409adf None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-129eeb28-e85b-44d2-8e2f-f5bbbf409adf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:31:53.582116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:53.583244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 15:31:53.584417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:53.588051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 403/804] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:31:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:31:53.589343 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:53.695967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f28010-986f-4e22-abc7-3057d3265d0a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:53.732620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:53.733295 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:53.733586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:53.733868 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:53.734671 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:53.734986 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:53.736651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:53.762186 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d196d-17e5-4d5d-a232-41c5f4cf9f88 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:53.762477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d196d-17e5-4d5d-a232-41c5f4cf9f88 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:53.762760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d196d-17e5-4d5d-a232-41c5f4cf9f88 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:53.764150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 404/805] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:31:53.768985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f89b-f1d0-416f-a99a-0377b389ae01 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:53.769276 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f89b-f1d0-416f-a99a-0377b389ae01 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:53.769558 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f89b-f1d0-416f-a99a-0377b389ae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:53.775335 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 402/806] 10.222.0.94 () {56 vars in 1101 bytes} [Fri Jul 15 15:31:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:31:53.786678 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6093f89b-f1d0-416f-a99a-0377b389ae01 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:53.788479 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6093f89b-f1d0-416f-a99a-0377b389ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:53.861106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 405/807] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 15:31:53.886079 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:53.935665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:53.998040 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935906-6868-4585-b2fa-0eeaafbc3ba7 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:54.032287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a2bd0-02ca-4aa6-a74f-bdca424b35f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:54.032890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a2bd0-02ca-4aa6-a74f-bdca424b35f1 None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:54.033176 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a2bd0-02ca-4aa6-a74f-bdca424b35f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:54.033450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a2bd0-02ca-4aa6-a74f-bdca424b35f1 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:54.034269 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a2bd0-02ca-4aa6-a74f-bdca424b35f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:54.035640 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a2bd0-02ca-4aa6-a74f-bdca424b35f1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:54.049235 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 403/808] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:31:53 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:31:56.285288 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42137bf7-f8af-47bc-b75d-e23d6b040106 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:56.285848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42137bf7-f8af-47bc-b75d-e23d6b040106 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:56.285848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42137bf7-f8af-47bc-b75d-e23d6b040106 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:56.287322 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 406/809] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:56.292735 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06053ae-52a4-45ad-b4b2-4b1186a3e28d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:56.293101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06053ae-52a4-45ad-b4b2-4b1186a3e28d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:56.293311 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06053ae-52a4-45ad-b4b2-4b1186a3e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:56.310508 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f06053ae-52a4-45ad-b4b2-4b1186a3e28d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:56.312059 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f06053ae-52a4-45ad-b4b2-4b1186a3e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:56.382407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 404/810] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:56 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:56.405981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42137bf7-f8af-47bc-b75d-e23d6b040106 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:56.441274 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:56.506867 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42137bf7-f8af-47bc-b75d-e23d6b040106 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:56.539133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:56.539890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:56.540180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:56.540460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:56.541112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:56.542478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:56.554571 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:56.555696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:31:56.556720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 407/811] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:56.561824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06053ae-52a4-45ad-b4b2-4b1186a3e28d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:56.592023 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:56.660065 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06053ae-52a4-45ad-b4b2-4b1186a3e28d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:56.693605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:56.694268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:56.694555 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:56.694833 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:56.695539 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:56.695884 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:56.697245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:56.702055 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 405/812] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:56.708259 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:56.802981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:56.805831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35380b2d-15d8-4d4a-a131-8f880639d28d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:56.838477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:56.839125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:56.839414 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:56.839697 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:56.840434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:56.840746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:56.842114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:56.846777 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 408/813] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:56.853130 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:56.944781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:56.950803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01fef7-1cd8-4621-9108-63a6a819e8a0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:56.984009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda6f9f-624a-4c27-80b9-dd29bfefe03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:56.984669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda6f9f-624a-4c27-80b9-dd29bfefe03f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:56.984953 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda6f9f-624a-4c27-80b9-dd29bfefe03f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:56.985229 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda6f9f-624a-4c27-80b9-dd29bfefe03f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:56.986015 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda6f9f-624a-4c27-80b9-dd29bfefe03f None admin] RBAC: Adding query filter params (interface=public, service_id=c089258ee3c54739b2b72dc9304ad952, region_id=RegionOne) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:56.986330 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda6f9f-624a-4c27-80b9-dd29bfefe03f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:56.987689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda6f9f-624a-4c27-80b9-dd29bfefe03f None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:56.993207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 406/814] 10.222.0.94 () {56 vars in 1251 bytes} [Fri Jul 15 15:31:56 2022] GET /identity/v3/endpoints?service_id=c089258ee3c54739b2b72dc9304ad952&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:56.998780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:57.096251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c71a1-5037-4a6a-83b8-3101c360644c None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:57.129283 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236e23a-4dfa-4254-a6a6-d6d68f179e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:57.129969 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236e23a-4dfa-4254-a6a6-d6d68f179e68 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:57.130262 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236e23a-4dfa-4254-a6a6-d6d68f179e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:57.130578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236e23a-4dfa-4254-a6a6-d6d68f179e68 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:57.131271 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236e23a-4dfa-4254-a6a6-d6d68f179e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:57.132667 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236e23a-4dfa-4254-a6a6-d6d68f179e68 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:57.138688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 409/815] 10.222.0.94 () {56 vars in 1087 bytes} [Fri Jul 15 15:31:56 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:31:59.404009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c033db-cdb7-45eb-83df-6b251cfef68d None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:59.404531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c033db-cdb7-45eb-83df-6b251cfef68d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:59.404642 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c033db-cdb7-45eb-83df-6b251cfef68d None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:59.405928 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 407/816] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:31:59.411259 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe99c5-5fff-4ff5-89c2-992bdeaedd38 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:59.411647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe99c5-5fff-4ff5-89c2-992bdeaedd38 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:59.411849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe99c5-5fff-4ff5-89c2-992bdeaedd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:59.428616 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6cfe99c5-5fff-4ff5-89c2-992bdeaedd38 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:31:59.429795 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6cfe99c5-5fff-4ff5-89c2-992bdeaedd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:31:59.452143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:59.495016 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 410/817] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:31:59 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:31:59.518939 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c033db-cdb7-45eb-83df-6b251cfef68d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:59.616982 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c033db-cdb7-45eb-83df-6b251cfef68d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:59.651620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:59.652436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:59.652719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:59.652994 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:59.653637 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:59.655041 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:31:59.667118 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:31:59.673129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:31:59.674193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 408/818] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:31:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:31:59.675179 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe99c5-5fff-4ff5-89c2-992bdeaedd38 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:59.769253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe99c5-5fff-4ff5-89c2-992bdeaedd38 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:59.815314 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:59.816004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:59.816292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:59.816573 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:59.817282 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:59.817591 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:59.819037 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:59.823825 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 411/819] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:59.829718 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:59.855289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:31:59.928972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819354a-9de1-497b-812a-779afbbe29d8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:31:59.960746 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932da299-eea0-4829-a2ea-a2005d22062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:31:59.961402 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da299-eea0-4829-a2ea-a2005d22062c None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:31:59.961689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da299-eea0-4829-a2ea-a2005d22062c None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:31:59.961970 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da299-eea0-4829-a2ea-a2005d22062c None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:31:59.962670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932da299-eea0-4829-a2ea-a2005d22062c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:31:59.962986 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932da299-eea0-4829-a2ea-a2005d22062c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:31:59.964381 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932da299-eea0-4829-a2ea-a2005d22062c None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:31:59.969286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 409/820] 10.222.0.94 () {56 vars in 1112 bytes} [Fri Jul 15 15:31:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:31:59.975387 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:31:59.999829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:00.073901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a971c-557f-4280-85e8-92f36f3316f3 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:32:00.109488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26957901-0f48-4ce1-9a63-34d3141b02af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:32:00.110141 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957901-0f48-4ce1-9a63-34d3141b02af None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:32:00.110425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957901-0f48-4ce1-9a63-34d3141b02af None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:32:00.110703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957901-0f48-4ce1-9a63-34d3141b02af None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:32:00.111450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26957901-0f48-4ce1-9a63-34d3141b02af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:32:00.112854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26957901-0f48-4ce1-9a63-34d3141b02af None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:32:00.130475 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 412/821] 10.222.0.94 () {60 vars in 1144 bytes} [Fri Jul 15 15:31:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:32:09.966825 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=56 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:32:10.126022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:00.616473 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6c7e-9165-4018-994b-b47b243a4b21 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:00.617153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6c7e-9165-4018-994b-b47b243a4b21 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:00.617153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6c7e-9165-4018-994b-b47b243a4b21 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:00.618860 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 410/822] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:00.625659 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f8691-f59e-47db-8d93-68ce059526a3 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:00.626977 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f8691-f59e-47db-8d93-68ce059526a3 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:00.627336 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f8691-f59e-47db-8d93-68ce059526a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:00.653569 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-590f8691-f59e-47db-8d93-68ce059526a3 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:00.654748 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-590f8691-f59e-47db-8d93-68ce059526a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:00.743507 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 413/823] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:00.771324 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6c7e-9165-4018-994b-b47b243a4b21 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:00.896925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6c7e-9165-4018-994b-b47b243a4b21 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:00.936070 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:00.936915 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:00.937244 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:00.937613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:00.951841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:00.953613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:00.975822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:00.977208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:00.983270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:00.983270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:00.983270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:00.983270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:00.983270 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 411/824] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:00.983648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f8691-f59e-47db-8d93-68ce059526a3 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:01.099710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f8691-f59e-47db-8d93-68ce059526a3 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:01.133175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:01.146780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee32014-6280-46b2-acb1-511ee0e3d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:01.147816 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32014-6280-46b2-acb1-511ee0e3d255 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:01.148057 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32014-6280-46b2-acb1-511ee0e3d255 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:01.148469 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee32014-6280-46b2-acb1-511ee0e3d255 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:01.149201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee32014-6280-46b2-acb1-511ee0e3d255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:01.149511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee32014-6280-46b2-acb1-511ee0e3d255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:01.151023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee32014-6280-46b2-acb1-511ee0e3d255 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:01.165088 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 414/825] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:01.171034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:01.236734 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:01.296354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68d60-314d-47ca-9719-519b3aef087d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:01.337391 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f31ab-f738-4e85-8fd4-5a732f7d019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:01.338280 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f31ab-f738-4e85-8fd4-5a732f7d019a None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:01.338735 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f31ab-f738-4e85-8fd4-5a732f7d019a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:01.339045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f31ab-f738-4e85-8fd4-5a732f7d019a None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:01.339896 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f31ab-f738-4e85-8fd4-5a732f7d019a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:01.341363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f31ab-f738-4e85-8fd4-5a732f7d019a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:01.363658 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 412/826] 10.222.0.94 () {60 vars in 1132 bytes} [Fri Jul 15 15:33:01 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:03.747012 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203107d-dc49-4394-9977-2d28fc095eb4 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:03.747561 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203107d-dc49-4394-9977-2d28fc095eb4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:03.747561 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203107d-dc49-4394-9977-2d28fc095eb4 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:03.749524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 415/827] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:03.757072 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2034-8e23-422a-9352-9d2ffa74796b None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:03.757501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2034-8e23-422a-9352-9d2ffa74796b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:03.757654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2034-8e23-422a-9352-9d2ffa74796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:03.776306 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7a2d2034-8e23-422a-9352-9d2ffa74796b None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:03.777515 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7a2d2034-8e23-422a-9352-9d2ffa74796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:03.850452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 413/828] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:03 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:03.876619 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203107d-dc49-4394-9977-2d28fc095eb4 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:03.992857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203107d-dc49-4394-9977-2d28fc095eb4 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.031216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.032091 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.032409 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.032748 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.044701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:33:04.053709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:04.054810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:04.056225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 416/829] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:33:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:04.061068 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d2034-8e23-422a-9352-9d2ffa74796b None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.104620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:04.177549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d2034-8e23-422a-9352-9d2ffa74796b None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.215461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.216288 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.216582 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.216882 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.217628 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:04.217931 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.219964 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.229471 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 414/830] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:04.235327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.288086 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:04.345393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa078cf3-3d7b-4590-bbec-e89f6abbb80a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.382331 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.383131 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.383425 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.383707 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.394159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.396080 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:04.417093 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:04.418230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:04.419114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:04.419114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:04.419114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:04.419114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:04.419114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 417/831] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:33:04.424256 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.539652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:04.542754 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0a616-6c44-494f-bcde-d4e46aa86dcf None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.580961 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.581632 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.581921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.582201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.582933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:04.583253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.584633 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.599467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 415/832] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:04.606077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.726579 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:04.730728 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77f6e3-38c0-464a-86a5-53946ee51687 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.768352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.769156 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.769437 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.769716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.780289 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.782020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:33:04.798674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:04.799928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:04.801090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 418/833] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:04.805872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:04.924012 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dc786-3b6b-4e2d-a8fc-e12216a54914 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:04.969246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:04.969953 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:04.970291 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:04.970570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:04.971414 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:04.971723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:04.973284 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:04.996793 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 416/834] 10.222.0.94 () {56 vars in 1143 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:04.998063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:05.118545 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd8cae-4cdb-483a-8eef-d969ab6ceff1 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:05.159123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:05.159123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:05.159123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:05.159123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:05.189157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:05.231657 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:05.233537 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:05.343356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 419/835] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:33:04 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 15:33:05.349663 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:05.370977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:05.465215 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e63c6c-e50e-452c-8848-ebe85f4fbf71 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:05.504927 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:05.505876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:05.506209 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:05.506495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:05.519247 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:05.520934 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:05.542761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:05.543900 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:05.544923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:05.544923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:05.544923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:05.544923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:05.544923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 417/836] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:05.550596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:05.610870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:05.661312 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3b00d-dd40-47f3-b518-3a491ab28a8a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:05.699156 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:05.699876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:05.700167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:05.700445 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:05.701169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:05.701480 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:05.702855 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:05.715837 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 420/837] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:33:05.722476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:05.795115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:05.830339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c3342-a46c-4dff-b62c-6ee9502124c8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:05.868920 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:05.869718 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:05.870081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:05.870361 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:05.877972 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:05.879494 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:33:05.894804 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:05.896020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:05.897018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 418/838] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:33:05.902836 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:06.012627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e74667-c120-4cbb-b3f9-9d6ddc2c5a47 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:06.030654 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:06.048315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ed325-e445-4e38-98c2-c9f7f3a16a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:06.049006 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ed325-e445-4e38-98c2-c9f7f3a16a66 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:06.049312 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ed325-e445-4e38-98c2-c9f7f3a16a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:06.049642 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ed325-e445-4e38-98c2-c9f7f3a16a66 None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:06.050386 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ed325-e445-4e38-98c2-c9f7f3a16a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:06.050698 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ed325-e445-4e38-98c2-c9f7f3a16a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:06.052201 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ed325-e445-4e38-98c2-c9f7f3a16a66 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:06.064539 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 421/839] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:06.070874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:06.183167 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6f5b-246f-411e-a688-281fcd0382fb None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:06.213904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:06.222145 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee0a8-aef1-4060-8ed6-dbd53e528cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:06.222936 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee0a8-aef1-4060-8ed6-dbd53e528cf1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:06.223290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee0a8-aef1-4060-8ed6-dbd53e528cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:06.223631 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee0a8-aef1-4060-8ed6-dbd53e528cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:06.224578 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dee0a8-aef1-4060-8ed6-dbd53e528cf1 None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=975c6f6b7fcd43ef83401317a46fc925) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:06.224947 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dee0a8-aef1-4060-8ed6-dbd53e528cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:06.226436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dee0a8-aef1-4060-8ed6-dbd53e528cf1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:06.232178 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 419/840] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:33:06 2022] GET /identity/v3/role_assignments?user.id=975c6f6b7fcd43ef83401317a46fc925&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:08.496205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd9ac-853c-47ef-a769-a2795b214ca0 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:08.496813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd9ac-853c-47ef-a769-a2795b214ca0 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:08.496813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd9ac-853c-47ef-a769-a2795b214ca0 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:08.498274 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 422/841] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:08.503932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ba491-bad6-4da1-a4bb-9d68cb042bdf None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:08.504365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ba491-bad6-4da1-a4bb-9d68cb042bdf None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:08.504500 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ba491-bad6-4da1-a4bb-9d68cb042bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:08.527014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-462ba491-bad6-4da1-a4bb-9d68cb042bdf None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:08.528746 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-462ba491-bad6-4da1-a4bb-9d68cb042bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:08.603933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 420/842] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:08.627656 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd9ac-853c-47ef-a769-a2795b214ca0 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:08.747413 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd9ac-853c-47ef-a769-a2795b214ca0 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:08.784251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:08.785146 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:08.785504 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:08.785853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:08.796035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:33:08.803966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:08.805105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:08.810917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 423/843] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:33:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:08.811620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ba491-bad6-4da1-a4bb-9d68cb042bdf None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:08.917423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ba491-bad6-4da1-a4bb-9d68cb042bdf None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:08.945980 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:08.958821 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:08.959526 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:08.959849 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:08.960136 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:08.960890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] RBAC: Adding query filter params (name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:08.961203 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:08.962836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:08.972048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 421/844] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:33:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:08.977915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:09.020892 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:09.092311 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd7f8d-cac1-4ee0-927d-b35bee2aaa0d None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:09.128694 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:09.130179 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:09.130466 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:09.130741 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:09.142926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:09.144444 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:09.163198 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:09.164188 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:09.165408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:09.165408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:09.165408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:09.165408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:09.165408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 424/845] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:09.170570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:09.282481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285615-ef66-4520-b7b6-4451bb1fa208 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:09.317932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:09.318599 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:09.318885 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:09.319159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:09.319905 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:09.320215 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:09.321566 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:09.334923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 422/846] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:09.341511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:09.441836 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:09.451473 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae5322-4a90-448b-80ee-17816d64227b None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:09.489121 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:09.489937 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:09.490205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:09.490477 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:09.498493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:09.500823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:33:09.517780 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:09.519062 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:09.520150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 425/847] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:09.525245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:09.575406 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:09.635452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5e56-5b54-400d-81e6-ede7c265f8b6 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:09.679144 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:09.679907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:09.680200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:09.680527 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:09.681449 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:09.681826 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:09.683318 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:09.704330 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 423/848] 10.222.0.94 () {56 vars in 1143 bytes} [Fri Jul 15 15:33:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:09.710494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:09.822686 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863ce7f-0958-485d-b1d7-6e2a50c36047 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:09.860637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:09.861355 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:09.861641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:09.861918 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:09.872729 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:09.874457 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:09.893494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:09.894454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:09.895596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:09.895596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:09.895596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:09.895596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:09.895596 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 426/849] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:09.901190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:10.012700 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce086db-f12f-4b39-830b-5ba7110e2128 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:10.015062 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:10.050677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:10.051394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:10.051636 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:10.051949 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:10.052679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:10.052990 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:10.054413 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:10.067666 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 424/850] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:33:10.073467 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:10.076872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:10.186990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972e26-3258-4e0c-93d0-7e79052b300f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:10.229098 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:10.230115 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:10.230437 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:10.230815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:10.239357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:10.240968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:33:10.256947 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:10.257950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:10.258979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 427/851] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:10.264168 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:10.374890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5d671-1511-446f-810b-feade33025d3 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:10.413169 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17fa28-7d98-433f-89e3-d4f2c6a98196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:10.413925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fa28-7d98-433f-89e3-d4f2c6a98196 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:10.414373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fa28-7d98-433f-89e3-d4f2c6a98196 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:10.414846 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17fa28-7d98-433f-89e3-d4f2c6a98196 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:10.416089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17fa28-7d98-433f-89e3-d4f2c6a98196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:10.416402 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17fa28-7d98-433f-89e3-d4f2c6a98196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:10.418478 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17fa28-7d98-433f-89e3-d4f2c6a98196 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:10.432570 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 425/852] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:10.439055 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:10.512038 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:10.567376 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f5ea7-dc22-458e-a82b-4cb1dbcb4910 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:10.619155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7722f-1052-4ba8-8010-a658af00123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:10.620074 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7722f-1052-4ba8-8010-a658af00123f None admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:10.620360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7722f-1052-4ba8-8010-a658af00123f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:10.620638 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7722f-1052-4ba8-8010-a658af00123f None admin] PATH_INFO: `/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/975c6f6b7fcd43ef83401317a46fc925/roles/15dc4243dee04db2b0c9a13117f83873` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:10.637762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7722f-1052-4ba8-8010-a658af00123f None admin] RBAC: Authorizing `identity:create_grant(project_id=703e07bc59894ec3ab0de167388fa57b, user_id=975c6f6b7fcd43ef83401317a46fc925, role_id=15dc4243dee04db2b0c9a13117f83873)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:10.639144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7722f-1052-4ba8-8010-a658af00123f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:10.656444 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 428/853] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:33:10 2022] PUT /identity/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/975c6f6b7fcd43ef83401317a46fc925/roles/15dc4243dee04db2b0c9a13117f83873 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:12.933456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688badd6-a5d0-48be-92b1-63c8629994d8 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:12.934070 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688badd6-a5d0-48be-92b1-63c8629994d8 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:12.934193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688badd6-a5d0-48be-92b1-63c8629994d8 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:12.935623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 426/854] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:12.941401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56951bd-3ec2-452d-ae23-7f1cc457b24d None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:12.941875 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56951bd-3ec2-452d-ae23-7f1cc457b24d None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:12.941989 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56951bd-3ec2-452d-ae23-7f1cc457b24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:12.960544 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-c56951bd-3ec2-452d-ae23-7f1cc457b24d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:12.961746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-c56951bd-3ec2-452d-ae23-7f1cc457b24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:13.038214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 429/855] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:12 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:13.064558 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688badd6-a5d0-48be-92b1-63c8629994d8 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:13.093509 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:13.181081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688badd6-a5d0-48be-92b1-63c8629994d8 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:13.224017 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:13.225110 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:13.225610 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:13.225886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:13.238002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:33:13.248921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:13.250553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 15:33:13.251504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:13.253112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 427/856] 10.222.0.94 () {56 vars in 1102 bytes} [Fri Jul 15 15:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:13.259253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56951bd-3ec2-452d-ae23-7f1cc457b24d None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:13.306357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:13.365586 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56951bd-3ec2-452d-ae23-7f1cc457b24d None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:13.403871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:13.404587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:13.404901 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:13.405187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:13.405973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] RBAC: Adding query filter params (name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:13.406292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:13.407722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:13.416532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 430/857] 10.222.0.94 () {56 vars in 1103 bytes} [Fri Jul 15 15:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:13.422624 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:13.514397 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:13.533109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa0e4c-b5d3-470d-b05b-93be31b301aa None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:13.573226 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:13.574029 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:13.574320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:13.574612 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:13.586274 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:13.587786 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:13.613758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:13.615045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:13.616158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:13.616158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:13.616158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:13.616158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:13.622869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 428/858] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:13.624246 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:13.745628 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d811bc-ac6a-4592-b2f0-02b977d37629 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:13.747964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:13.788150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:13.788778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:13.789094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:13.789556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:13.790557 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:13.790885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:13.792489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:13.805920 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 431/859] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:33:13.811651 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:13.927764 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25ba7f-0ac4-4579-a95b-f7c3483e5b6e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:13.966670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:13.967512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:13.967832 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:13.968110 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:13.972016 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:13.981315 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:13.982753 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:33:13.998965 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:14.000339 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:14.001644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 429/860] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:14.005997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:14.118674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30597076-3ade-43a5-9fe2-03c0e0c8d50a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:14.162099 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:14.162773 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:14.163064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:14.163351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:14.164225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:14.164566 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:14.165991 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:14.184578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 432/861] 10.222.0.94 () {56 vars in 1143 bytes} [Fri Jul 15 15:33:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:14.190687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:14.307275 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f3559-bc2b-4091-8aec-68b69d5064a0 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:14.344544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:14.345219 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:14.345482 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:14.345764 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:14.410602 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:14.418266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:14.419730 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:14.524205 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 430/862] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:33:14 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:33:14.530309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:14.555864 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:14.641427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43154be-cba9-4863-bd9c-d32b4256d9f7 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:14.682534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:14.683219 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:14.683502 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:14.683848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:14.699420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:14.701016 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:14.727287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:14.728670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:14.730143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:14.730143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:14.730143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:14.730143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:14.731961 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 433/863] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:14.738086 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:14.857826 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:14.864048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d170e2-bbe3-4be0-bb83-a57292e45aa8 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:14.903467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:14.904164 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:14.904453 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:14.904733 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:14.905450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:14.905758 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:14.907188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:14.919407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 431/864] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:14.925449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:15.010176 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:15.036889 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be89d9-1a5f-4be4-ac42-9e10cf8d5f31 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:15.074762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:15.075957 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:15.076305 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:15.076640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:15.085726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:15.087703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:33:15.105399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:15.106489 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:15.107574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 434/865] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:15.113560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:15.230497 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e32c7-c8aa-41a2-a494-bff4652c83a3 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:15.264546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01239907-6e23-426a-87f3-3fe4db784000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:15.265716 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01239907-6e23-426a-87f3-3fe4db784000 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:15.266642 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01239907-6e23-426a-87f3-3fe4db784000 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:15.266642 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01239907-6e23-426a-87f3-3fe4db784000 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:15.267043 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01239907-6e23-426a-87f3-3fe4db784000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:15.267352 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01239907-6e23-426a-87f3-3fe4db784000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:15.268812 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01239907-6e23-426a-87f3-3fe4db784000 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:15.281988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 432/866] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:15.288160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:15.398149 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d216-6b9a-4dbb-9c30-3b951119850e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:15.435775 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b6d73-23a7-4f0e-8f3c-aa0ee3bf8efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:15.436427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b6d73-23a7-4f0e-8f3c-aa0ee3bf8efd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:15.436715 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b6d73-23a7-4f0e-8f3c-aa0ee3bf8efd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:15.436992 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b6d73-23a7-4f0e-8f3c-aa0ee3bf8efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:15.438467 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b6d73-23a7-4f0e-8f3c-aa0ee3bf8efd None admin] RBAC: Adding query filter params (role.id=15dc4243dee04db2b0c9a13117f83873, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=975c6f6b7fcd43ef83401317a46fc925) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:15.438836 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b6d73-23a7-4f0e-8f3c-aa0ee3bf8efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:15.440542 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b6d73-23a7-4f0e-8f3c-aa0ee3bf8efd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:15.442787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:15.449023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 435/867] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:33:15 2022] GET /identity/v3/role_assignments?user.id=975c6f6b7fcd43ef83401317a46fc925&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=15dc4243dee04db2b0c9a13117f83873 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:18.315356 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad43e51-48b1-4642-af56-32a9c88bc587 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:18.315986 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad43e51-48b1-4642-af56-32a9c88bc587 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:18.315986 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad43e51-48b1-4642-af56-32a9c88bc587 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:18.317341 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 433/868] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:18.324478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef230df-92fb-4934-8e32-b12852129884 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:18.324925 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef230df-92fb-4934-8e32-b12852129884 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:18.325085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef230df-92fb-4934-8e32-b12852129884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:18.342042 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-fef230df-92fb-4934-8e32-b12852129884 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:18.343858 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-fef230df-92fb-4934-8e32-b12852129884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:18.418221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 436/869] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:18 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:18.443048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad43e51-48b1-4642-af56-32a9c88bc587 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:18.463089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:18.556631 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad43e51-48b1-4642-af56-32a9c88bc587 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:18.599279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:18.599951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:18.600244 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:18.600527 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:18.610854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:33:18.618683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:18.619893 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:18.620904 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 434/870] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:18.627431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef230df-92fb-4934-8e32-b12852129884 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:18.749983 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef230df-92fb-4934-8e32-b12852129884 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:18.783937 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:18.793585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:18.794262 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:18.794549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:18.794828 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:18.795578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:18.795928 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:18.797857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:18.807033 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 437/871] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:18.813829 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:18.897033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:18.924784 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345db48-0919-4236-9844-fd7fec38e33f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:18.962222 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:18.963039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:18.963328 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:18.963612 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:18.975701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:18.977499 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:18.996876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:19.000052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:19.001113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:19.001113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:19.001113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:19.001113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:19.001113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 435/872] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:19.004257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:19.111796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100bf51-b6ff-4242-9da0-5396b1ab0d70 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:19.153703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:19.154280 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.154568 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.154845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:19.155825 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:19.156147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:19.157517 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:19.171032 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 438/873] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:33:19.176856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:19.285802 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b2f1f-695c-4501-93b4-f3bf8512a54b None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:19.314744 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:19.323961 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:19.324776 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.325076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.325341 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:19.334032 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:19.335560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:33:19.351220 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:19.352303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:19.353614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 436/874] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:19.358313 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:19.415199 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:19.467926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489deddf-7c07-48d6-9132-88aee01651f5 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:19.510441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:19.511454 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.511770 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.512135 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:19.513223 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:19.513633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:19.516022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:19.537045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 439/875] 10.222.0.94 () {56 vars in 1143 bytes} [Fri Jul 15 15:33:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:33:19.543546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:19.666355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5539e-a83a-4dea-9d0d-c99e74d2df04 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:19.709591 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:19.710531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:19.710757 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:19.711124 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:19.772512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:19.786365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:19.787852 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:19.891489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 437/876] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:33:19 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:33:19.897807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.006535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402008c-042b-4a23-93b0-714a092bdd95 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.017340 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:20.047357 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.048385 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.048670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.048945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.060434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.061926 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:20.080611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:20.081760 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:20.082683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:20.082683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:20.082683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:20.082683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:20.082683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 440/877] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:20.088282 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.183632 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:20.197017 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52048fb1-113e-45b2-84ea-5f58f0b1ba5e None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.232003 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.232621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.232912 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.233194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.233975 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:20.234287 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.235656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.247054 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 438/878] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:20.254114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.354691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e19d4c-44f3-4e12-bf52-e642ce137cd8 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.390447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.391234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.391516 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.391817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.398356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.399814 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:33:20.413647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:20.414681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:20.415948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 441/879] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:20.421069 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.517919 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271c15a-c24a-4be2-89ad-5157086d48dd None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.550493 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c847c-9f03-4e5e-9c6a-f3ab3abdc078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.551140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c847c-9f03-4e5e-9c6a-f3ab3abdc078 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.551429 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c847c-9f03-4e5e-9c6a-f3ab3abdc078 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.551835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c847c-9f03-4e5e-9c6a-f3ab3abdc078 None admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.552607 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c847c-9f03-4e5e-9c6a-f3ab3abdc078 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:20.552919 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c847c-9f03-4e5e-9c6a-f3ab3abdc078 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.554331 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c847c-9f03-4e5e-9c6a-f3ab3abdc078 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.566011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 439/880] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:20.572203 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:20.595915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:20.679606 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fae2c6-2f35-4fe2-a809-8115ac2c083a None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:20.714279 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811326-5ccc-4f60-9fcb-892e9e235d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:20.714933 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811326-5ccc-4f60-9fcb-892e9e235d84 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:20.715220 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811326-5ccc-4f60-9fcb-892e9e235d84 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:20.715499 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811326-5ccc-4f60-9fcb-892e9e235d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:20.716374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811326-5ccc-4f60-9fcb-892e9e235d84 None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=975c6f6b7fcd43ef83401317a46fc925) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:20.716689 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811326-5ccc-4f60-9fcb-892e9e235d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:20.718687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811326-5ccc-4f60-9fcb-892e9e235d84 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:20.724017 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 442/881] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:33:20 2022] GET /identity/v3/role_assignments?user.id=975c6f6b7fcd43ef83401317a46fc925&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=8442e7332b934407beff8c3564575b62 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:22.949508 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1983d-e46e-49c1-b286-d3a9a134373b None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:22.950033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1983d-e46e-49c1-b286-d3a9a134373b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:22.950151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1983d-e46e-49c1-b286-d3a9a134373b None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:22.951445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 440/882] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:22.956701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afcae2-ddba-46c7-975a-af21e5924948 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:22.957085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afcae2-ddba-46c7-975a-af21e5924948 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:22.957255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afcae2-ddba-46c7-975a-af21e5924948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:22.974610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-03afcae2-ddba-46c7-975a-af21e5924948 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:22.975849 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-03afcae2-ddba-46c7-975a-af21e5924948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:23.040867 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 443/883] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:22 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:23.064878 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1983d-e46e-49c1-b286-d3a9a134373b None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.075604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:23.171701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1983d-e46e-49c1-b286-d3a9a134373b None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.204384 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.205103 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.205388 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.205665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.215831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:33:23.224445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:23.230810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:23.231894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 441/884] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:23.232744 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afcae2-ddba-46c7-975a-af21e5924948 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.247020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:23.328007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afcae2-ddba-46c7-975a-af21e5924948 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.360663 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.361325 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.361611 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.361889 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.362626 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:23.362931 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:23.364339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:23.372161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 444/885] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:23.378127 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.442888 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:23.475870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dc90c-ed83-4a6b-9644-0356e62d950f None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.508643 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.509422 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.509709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.509986 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.520767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:23.522188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:23.538839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:23.539898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:23.541148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:23.541148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:23.541148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:23.541148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:23.541148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 442/886] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:23.545746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.620683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:23.645123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810732ca-fbcf-4c9c-bab5-f03628fa9b9f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.685139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.685800 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.686085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.686361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.687101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:23.687407 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:23.688895 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:23.702735 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 445/887] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:23.710224 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.813348 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5390f-f5ca-4a32-99af-f63d6d577474 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:23.834066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:23.848174 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:23.848979 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:23.849266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:23.849550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:23.856886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:23.858359 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:33:23.872459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:23.873789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:23.875505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 443/888] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:23.880522 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:23.978627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6581-4136-4841-862c-b7d539702ea0 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.013442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.014107 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.014394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.015207 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.016157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:24.016471 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.017906 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.020501 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:24.035112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 446/889] 10.222.0.94 () {56 vars in 1143 bytes} [Fri Jul 15 15:33:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:24.040811 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.144158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9f82-61fd-48de-bc57-4b36659b15d9 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.179256 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.180076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.180366 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.180645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.191175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.192940 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:24.210281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:24.211329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:24.212312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:24.212312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:24.212312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:24.212312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:24.212312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 444/890] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:24.217287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.314747 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e892ca7-c5ef-46be-91c9-6d6255890ed6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.347887 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.348533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.348821 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.349100 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.349822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:24.350132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.351508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.362409 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 447/891] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:24.368120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.401188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:24.470041 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff853464-87bf-4409-b65c-3f6d38da8142 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.503283 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.504093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.504377 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.504647 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.511143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.512602 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:33:24.526923 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:24.527983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:24.529011 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 445/892] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:24.534121 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.587804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:24.631400 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb3c9-7b06-4748-92ad-4d7f6996fd6f None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.672077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664ecd1-feac-490c-86cc-afac00f18248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.673059 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664ecd1-feac-490c-86cc-afac00f18248 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.673564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664ecd1-feac-490c-86cc-afac00f18248 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.673898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664ecd1-feac-490c-86cc-afac00f18248 None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.675334 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664ecd1-feac-490c-86cc-afac00f18248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:24.676046 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664ecd1-feac-490c-86cc-afac00f18248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.678441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664ecd1-feac-490c-86cc-afac00f18248 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.692457 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 448/893] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:24.698435 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:24.788004 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:24.797109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27965cd1-a40a-4442-bd1c-440e3a9146d7 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:24.830518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb191f-d870-41c8-9803-4df29de73f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:24.831409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb191f-d870-41c8-9803-4df29de73f18 None admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:24.831700 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb191f-d870-41c8-9803-4df29de73f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:24.832014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb191f-d870-41c8-9803-4df29de73f18 None admin] PATH_INFO: `/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/975c6f6b7fcd43ef83401317a46fc925/roles/8442e7332b934407beff8c3564575b62` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:24.834173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb191f-d870-41c8-9803-4df29de73f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=703e07bc59894ec3ab0de167388fa57b, user_id=975c6f6b7fcd43ef83401317a46fc925, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:24.835405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb191f-d870-41c8-9803-4df29de73f18 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:24.848534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 446/894] 10.222.0.94 () {58 vars in 1439 bytes} [Fri Jul 15 15:33:24 2022] PUT /identity/v3/projects/703e07bc59894ec3ab0de167388fa57b/users/975c6f6b7fcd43ef83401317a46fc925/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:33:27.038713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3cb93-d915-495c-8cea-54b6d7788290 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:27.039209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3cb93-d915-495c-8cea-54b6d7788290 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:27.039323 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3cb93-d915-495c-8cea-54b6d7788290 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:27.040689 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 449/895] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:27.045841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dfeaf-f955-4504-87d8-7b82dfb55946 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:27.046250 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dfeaf-f955-4504-87d8-7b82dfb55946 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:27.046409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dfeaf-f955-4504-87d8-7b82dfb55946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:27.062996 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-3b4dfeaf-f955-4504-87d8-7b82dfb55946 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:27.064213 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-3b4dfeaf-f955-4504-87d8-7b82dfb55946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:27.129201 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 447/896] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:27.154143 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3cb93-d915-495c-8cea-54b6d7788290 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:27.254379 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3cb93-d915-495c-8cea-54b6d7788290 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:27.267931 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:27.287388 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:27.288202 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:27.288496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:27.288776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:27.299647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 15:33:27.307333 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:27.308465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:27.309623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 450/897] 10.222.0.94 () {56 vars in 1096 bytes} [Fri Jul 15 15:33:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:27.315173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dfeaf-f955-4504-87d8-7b82dfb55946 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:27.393987 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:27.412438 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dfeaf-f955-4504-87d8-7b82dfb55946 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:27.445155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:27.445808 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:27.446094 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:27.446371 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:27.447107 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:27.447414 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:27.448808 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:27.456670 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 448/898] 10.222.0.94 () {56 vars in 1099 bytes} [Fri Jul 15 15:33:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:27.462409 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:27.562390 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f9394-03b2-4720-8380-ab0e90374d02 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:27.594360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:27.595134 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:27.595418 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:27.595692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:27.605788 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:27.607253 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:27.624564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:27.625605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:27.626701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:27.626701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:27.626701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:27.626701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:27.626701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 451/899] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:27.631447 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:27.738512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae3b56-c152-4d69-8ee7-d7d7359dff0d None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:27.771173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:27.771860 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:27.772148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:27.772423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:27.773128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:27.773436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:27.774789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:27.786854 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 449/900] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:27.792816 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:27.819986 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:27.892225 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91939c4-e612-4e39-b2b7-cd4c3cea2c77 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:27.924415 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:27.925197 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:27.925481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:27.925756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:27.933682 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:27.935109 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 15:33:27.949416 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:27.950530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:27.951442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 452/901] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 15:33:27.957140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:27.962815 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:28.061230 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b644666-fe94-4553-ab0d-a88134e2c0da None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:28.097316 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:28.097910 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:28.098198 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:28.098477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:28.099343 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:28.099653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:28.101101 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:28.123357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 450/902] 10.222.0.94 () {56 vars in 1143 bytes} [Fri Jul 15 15:33:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:33:28.125226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:28.211364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:28.226276 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aece394-e17a-448a-9b8c-09b4bcf4989e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:28.259629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:28.260303 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:28.260587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:28.260866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:28.325743 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:28.327715 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:28.409352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:28.424715 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 453/903] 10.222.0.94 () {58 vars in 1282 bytes} [Fri Jul 15 15:33:28 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 15:33:28.430705 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:28.490039 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:28.528355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43657f1-d9bb-4ebc-9ef5-c8f9ed87a01a None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:28.561930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:28.562722 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:28.563010 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:28.563290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:28.573223 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:28.574655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 15:33:28.591703 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:28.592794 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:28.593723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 15:33:28.593723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 15:33:28.593723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 15:33:28.593723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:28.593723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 451/904] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:28.598752 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:28.698308 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a5a45-3e02-4ba7-b383-40d89aee10cd None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:28.731708 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:28.732394 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:28.732683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:28.732992 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:28.733711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:28.734022 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:28.735395 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:28.746266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 454/905] 10.222.0.94 () {56 vars in 1109 bytes} [Fri Jul 15 15:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:28.752317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:28.850864 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe2985-2620-4d24-acf7-26317cf1ccf1 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:28.864281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:28.885197 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:28.885974 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:28.886255 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:28.886527 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:28.893523 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:28.894944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 15:33:28.908767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:28.909824 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: ERROR keystone.server.flask.application Jul 15 15:33:28.910761 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 452/906] 10.222.0.94 () {56 vars in 1111 bytes} [Fri Jul 15 15:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:28.915988 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:28.961985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:29.016007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478f0cc-38e4-42bb-82f4-cd6f23596de6 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:29.048281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac689c-66b1-47ca-94dd-ec30e9e37e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:29.048933 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac689c-66b1-47ca-94dd-ec30e9e37e2a None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:29.049224 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac689c-66b1-47ca-94dd-ec30e9e37e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:29.049508 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac689c-66b1-47ca-94dd-ec30e9e37e2a None admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:29.050300 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac689c-66b1-47ca-94dd-ec30e9e37e2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:29.050612 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac689c-66b1-47ca-94dd-ec30e9e37e2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:29.052070 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac689c-66b1-47ca-94dd-ec30e9e37e2a None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:29.064565 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 455/907] 10.222.0.94 () {56 vars in 1148 bytes} [Fri Jul 15 15:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:29.070661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:29.169628 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f617a31-d3dd-465a-b914-65aa73c52887 None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:29.202887 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d7c48-28a9-4aca-882d-75bf8665f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:29.203530 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7c48-28a9-4aca-882d-75bf8665f8ba None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:29.203843 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7c48-28a9-4aca-882d-75bf8665f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:29.204123 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d7c48-28a9-4aca-882d-75bf8665f8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:29.204936 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7c48-28a9-4aca-882d-75bf8665f8ba None admin] RBAC: Adding query filter params (role.id=8442e7332b934407beff8c3564575b62, scope.project.id=703e07bc59894ec3ab0de167388fa57b, user.id=975c6f6b7fcd43ef83401317a46fc925) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:29.205248 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7c48-28a9-4aca-882d-75bf8665f8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:29.206655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d7c48-28a9-4aca-882d-75bf8665f8ba None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:29.212527 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 453/908] 10.222.0.94 () {56 vars in 1374 bytes} [Fri Jul 15 15:33:29 2022] GET /identity/v3/role_assignments?user.id=975c6f6b7fcd43ef83401317a46fc925&scope.project.id=703e07bc59894ec3ab0de167388fa57b&role.id=8442e7332b934407beff8c3564575b62 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:31.444710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f8e5-ba83-4337-be34-07340a2f5262 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:31.445237 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f8e5-ba83-4337-be34-07340a2f5262 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:31.445237 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f8e5-ba83-4337-be34-07340a2f5262 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:31.446617 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 456/909] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:31.452317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f18e63-358b-48a7-b7f2-7825b763f6cf None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:31.452723 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f18e63-358b-48a7-b7f2-7825b763f6cf None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:31.452949 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f18e63-358b-48a7-b7f2-7825b763f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:31.469686 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f2f18e63-358b-48a7-b7f2-7825b763f6cf None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:31.470859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f2f18e63-358b-48a7-b7f2-7825b763f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:31.501258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:31.537822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 454/910] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:31 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:31.561907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f8e5-ba83-4337-be34-07340a2f5262 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:31.666572 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f8e5-ba83-4337-be34-07340a2f5262 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:31.676896 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:31.707860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:31.708534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:31.708906 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:31.709117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:31.709759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:31.711152 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:31.722897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:31.723981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:31.724818 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 457/911] 10.222.0.94 () {56 vars in 1117 bytes} [Fri Jul 15 15:33:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:31.730756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f18e63-358b-48a7-b7f2-7825b763f6cf None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:31.828320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f18e63-358b-48a7-b7f2-7825b763f6cf None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:31.862189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e358c61-2ec9-4c8c-9b5b-ed4d58820163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:31.862855 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e358c61-2ec9-4c8c-9b5b-ed4d58820163 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:31.863144 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e358c61-2ec9-4c8c-9b5b-ed4d58820163 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:31.863423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e358c61-2ec9-4c8c-9b5b-ed4d58820163 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:31.864158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e358c61-2ec9-4c8c-9b5b-ed4d58820163 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:31.864470 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e358c61-2ec9-4c8c-9b5b-ed4d58820163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:31.865832 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e358c61-2ec9-4c8c-9b5b-ed4d58820163 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:31.870621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 455/912] 10.222.0.94 () {56 vars in 1116 bytes} [Fri Jul 15 15:33:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:31.877179 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:31.976178 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aea991-86e2-43fe-aa99-907fedd3a9d7 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:32.009503 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0962f-213f-48a6-bf4b-200b25d50f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:32.010197 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0962f-213f-48a6-bf4b-200b25d50f49 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:32.010490 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0962f-213f-48a6-bf4b-200b25d50f49 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:32.010774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0962f-213f-48a6-bf4b-200b25d50f49 None admin] PATH_INFO: `/v3/services` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:32.011488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0962f-213f-48a6-bf4b-200b25d50f49 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:32.011830 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0962f-213f-48a6-bf4b-200b25d50f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:32.013231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0962f-213f-48a6-bf4b-200b25d50f49 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:32.018301 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 458/913] 10.222.0.94 () {56 vars in 1116 bytes} [Fri Jul 15 15:33:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:34.232449 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1755-5241-4ead-9e7e-c7dc2f40e3fb None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:34.233058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1755-5241-4ead-9e7e-c7dc2f40e3fb None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:34.233058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a1755-5241-4ead-9e7e-c7dc2f40e3fb None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:34.234401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 456/914] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:34.240414 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b48e9-488a-431c-9695-2cd8df614f6a None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:34.240852 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b48e9-488a-431c-9695-2cd8df614f6a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:34.240938 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b48e9-488a-431c-9695-2cd8df614f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:34.257637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-477b48e9-488a-431c-9695-2cd8df614f6a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:34.258910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-477b48e9-488a-431c-9695-2cd8df614f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:34.284639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:34.323266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 459/915] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:34 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:34.346776 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a1755-5241-4ead-9e7e-c7dc2f40e3fb None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:34.378320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:34.446528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a1755-5241-4ead-9e7e-c7dc2f40e3fb None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:34.479119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc61b47-acda-47a8-8e7c-1fff79300d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:34.479792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61b47-acda-47a8-8e7c-1fff79300d8d None admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:34.480086 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61b47-acda-47a8-8e7c-1fff79300d8d None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:34.480364 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc61b47-acda-47a8-8e7c-1fff79300d8d None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:34.481089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc61b47-acda-47a8-8e7c-1fff79300d8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:34.482440 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc61b47-acda-47a8-8e7c-1fff79300d8d None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:34.495719 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 457/916] 10.222.0.94 () {60 vars in 1141 bytes} [Fri Jul 15 15:33:34 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:33:36.720292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b11ef-2b18-42a2-adb8-a32558471f8e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:36.720862 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b11ef-2b18-42a2-adb8-a32558471f8e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:36.720968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b11ef-2b18-42a2-adb8-a32558471f8e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:36.722257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 460/917] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:36.727324 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686f3c5-f14c-4f0a-81ac-21a007df1453 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:36.727759 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686f3c5-f14c-4f0a-81ac-21a007df1453 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:36.727915 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686f3c5-f14c-4f0a-81ac-21a007df1453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:36.744315 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-1686f3c5-f14c-4f0a-81ac-21a007df1453 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:36.745506 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-1686f3c5-f14c-4f0a-81ac-21a007df1453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:36.817323 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 458/918] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:36 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:36.841054 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b11ef-2b18-42a2-adb8-a32558471f8e None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:36.941580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b11ef-2b18-42a2-adb8-a32558471f8e None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:36.974675 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:36.975472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:36.975871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:36.976123 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:36.976717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:36.978096 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:36.990487 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:36.991646 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:36.992526 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 461/919] 10.222.0.94 () {56 vars in 1117 bytes} [Fri Jul 15 15:33:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:37.001124 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686f3c5-f14c-4f0a-81ac-21a007df1453 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:37.019100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:37.097839 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686f3c5-f14c-4f0a-81ac-21a007df1453 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:37.131807 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:37.132467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:37.132751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:37.133029 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:37.133724 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] RBAC: Adding query filter params (name=placement) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:37.134033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:37.135400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:37.140654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 459/920] 10.222.0.94 () {56 vars in 1116 bytes} [Fri Jul 15 15:33:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:37.147684 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:37.176820 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:37.246815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de328f87-8e72-47ba-9c90-96f79faf6675 None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:37.280481 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd900bbc-75da-403b-adff-7a3621f47fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:37.281139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900bbc-75da-403b-adff-7a3621f47fc0 None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:37.281429 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900bbc-75da-403b-adff-7a3621f47fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:37.281718 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd900bbc-75da-403b-adff-7a3621f47fc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:37.282506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900bbc-75da-403b-adff-7a3621f47fc0 None admin] RBAC: Adding query filter params (interface=public, service_id=f7739bc5f94e4646b3ad68fea32f5e30, region_id=RegionOne) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:37.282823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900bbc-75da-403b-adff-7a3621f47fc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:37.284233 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd900bbc-75da-403b-adff-7a3621f47fc0 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:37.289266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 462/921] 10.222.0.94 () {56 vars in 1251 bytes} [Fri Jul 15 15:33:37 2022] GET /identity/v3/endpoints?service_id=f7739bc5f94e4646b3ad68fea32f5e30&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:37.295654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:37.375815 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:37.393666 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8fef2-1bfa-40eb-8025-956afe730dbd None admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:37.427034 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41aa4a-310d-46be-86cf-808222bdbb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:37.427699 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41aa4a-310d-46be-86cf-808222bdbb7b None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:37.428018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41aa4a-310d-46be-86cf-808222bdbb7b None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:37.428301 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41aa4a-310d-46be-86cf-808222bdbb7b None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:37.428976 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41aa4a-310d-46be-86cf-808222bdbb7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:37.430335 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41aa4a-310d-46be-86cf-808222bdbb7b None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:37.436764 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 460/922] 10.222.0.94 () {56 vars in 1087 bytes} [Fri Jul 15 15:33:37 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:33:39.643011 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427f820-c82f-43d7-87dc-d7263b73551f None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:39.643569 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427f820-c82f-43d7-87dc-d7263b73551f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:39.643569 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427f820-c82f-43d7-87dc-d7263b73551f None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:39.644984 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 463/923] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:33:39.650340 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5795dc-dbd0-48e1-a26d-402557ea85cf None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:39.650747 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5795dc-dbd0-48e1-a26d-402557ea85cf None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:39.650895 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5795dc-dbd0-48e1-a26d-402557ea85cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:39.667850 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-da5795dc-dbd0-48e1-a26d-402557ea85cf None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:33:39.669020 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-da5795dc-dbd0-48e1-a26d-402557ea85cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:33:39.735018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 461/924] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:33:39 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 15:33:39.758847 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427f820-c82f-43d7-87dc-d7263b73551f None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:39.850221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:39.860044 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427f820-c82f-43d7-87dc-d7263b73551f None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:39.894665 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:39.895398 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:39.895687 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:39.895997 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:39.896650 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:39.898019 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 15:33:39.910910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 15:33:39.912013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application with Lock( Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self._enter() Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application return self.creator() Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application created_value = creator( Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: ERROR keystone.server.flask.application Jul 15 15:33:39.912859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 464/925] 10.222.0.94 () {56 vars in 1117 bytes} [Fri Jul 15 15:33:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 15:33:39.918407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5795dc-dbd0-48e1-a26d-402557ea85cf None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:39.994130 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:40.017086 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5795dc-dbd0-48e1-a26d-402557ea85cf None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:40.050229 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a600c0-b383-49c0-b710-5bc2cf736965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:40.050888 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a600c0-b383-49c0-b710-5bc2cf736965 None admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:40.051168 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a600c0-b383-49c0-b710-5bc2cf736965 None admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:40.051444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a600c0-b383-49c0-b710-5bc2cf736965 None admin] PATH_INFO: `/v3/services` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:40.052171 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a600c0-b383-49c0-b710-5bc2cf736965 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:33:40.052477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a600c0-b383-49c0-b710-5bc2cf736965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:40.053835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a600c0-b383-49c0-b710-5bc2cf736965 None admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:40.058728 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 462/926] 10.222.0.94 () {56 vars in 1116 bytes} [Fri Jul 15 15:33:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:33:40.065251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:33:40.167189 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab20e08-cc25-4851-b43e-0cb62b9a406e None admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:33:40.200049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8daa-17d5-4d9b-bac7-833a9a636ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:33:40.200696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8daa-17d5-4d9b-bac7-833a9a636ba4 None admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:33:40.201010 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8daa-17d5-4d9b-bac7-833a9a636ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:33:40.201284 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8daa-17d5-4d9b-bac7-833a9a636ba4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:33:40.202007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8daa-17d5-4d9b-bac7-833a9a636ba4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:33:40.203364 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8daa-17d5-4d9b-bac7-833a9a636ba4 None admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:33:40.222167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 465/927] 10.222.0.94 () {60 vars in 1144 bytes} [Fri Jul 15 15:33:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:33:50.056252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=30 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:33:50.218026 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:38.711614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f808-f9b1-4e27-afc7-90e634f3a419 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:38.712261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f808-f9b1-4e27-afc7-90e634f3a419 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:38.712261 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39f808-f9b1-4e27-afc7-90e634f3a419 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:38.715908 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 463/928] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:38.719792 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba6c2-be48-4156-9155-0a9ba8c78eb1 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:38.720297 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba6c2-be48-4156-9155-0a9ba8c78eb1 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:38.720377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ba6c2-be48-4156-9155-0a9ba8c78eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:38.744175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-4c6ba6c2-be48-4156-9155-0a9ba8c78eb1 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:38.745436 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-4c6ba6c2-be48-4156-9155-0a9ba8c78eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:38.821964 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 466/929] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:38.873914 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb4ca-1876-42a3-8670-5633f33e68b1 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:38.874207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb4ca-1876-42a3-8670-5633f33e68b1 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:38.874676 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cb4ca-1876-42a3-8670-5633f33e68b1 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:38.876685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 464/930] 10.222.0.94 () {54 vars in 964 bytes} [Fri Jul 15 15:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:38.884639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7fd3-790a-44b2-b511-38047b52120b None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:38.885199 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7fd3-790a-44b2-b511-38047b52120b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:38.885711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7fd3-790a-44b2-b511-38047b52120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:38.976472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-879b7fd3-790a-44b2-b511-38047b52120b None None] MFA Rules not processed for user `8a31482a8d184d81a5569d11fcc53181`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:38.977683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-879b7fd3-790a-44b2-b511-38047b52120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:39.057948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 467/931] 10.222.0.94 () {58 vars in 1061 bytes} [Fri Jul 15 15:34:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:39.080911 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb4ca-1876-42a3-8670-5633f33e68b1 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:39.092451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cb4ca-1876-42a3-8670-5633f33e68b1 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:39.096076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de541f-ff6e-416d-9a06-0ddc5477d92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:39.096648 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de541f-ff6e-416d-9a06-0ddc5477d92a service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:39.096932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de541f-ff6e-416d-9a06-0ddc5477d92a service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:39.097228 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de541f-ff6e-416d-9a06-0ddc5477d92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:39.107200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de541f-ff6e-416d-9a06-0ddc5477d92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:39.108866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de541f-ff6e-416d-9a06-0ddc5477d92a service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:39.118933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 465/932] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:41.633665 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ad76-95ff-4077-a98f-5b911a7b6251 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:41.634232 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ad76-95ff-4077-a98f-5b911a7b6251 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:41.634232 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ad76-95ff-4077-a98f-5b911a7b6251 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:41.635637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 468/933] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:41.642110 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64df56-8796-446a-b514-75a99e78fd0e None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:41.642648 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64df56-8796-446a-b514-75a99e78fd0e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:41.642799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64df56-8796-446a-b514-75a99e78fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:41.661487 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-fb64df56-8796-446a-b514-75a99e78fd0e None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:41.662668 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-fb64df56-8796-446a-b514-75a99e78fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:41.670434 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 466/934] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:41.709530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ad76-95ff-4077-a98f-5b911a7b6251 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:41.720071 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1ad76-95ff-4077-a98f-5b911a7b6251 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:41.723588 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c6640-8685-4e43-9ff7-ebc270b87d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:41.724264 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c6640-8685-4e43-9ff7-ebc270b87d24 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:41.724554 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c6640-8685-4e43-9ff7-ebc270b87d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:41.724838 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c6640-8685-4e43-9ff7-ebc270b87d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:41.733807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c6640-8685-4e43-9ff7-ebc270b87d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:41.735254 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c6640-8685-4e43-9ff7-ebc270b87d24 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:41.744904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 469/935] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:44.362217 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59a8b-7637-49d3-8f9b-de9466753c5b None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:44.362787 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59a8b-7637-49d3-8f9b-de9466753c5b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:44.362787 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59a8b-7637-49d3-8f9b-de9466753c5b None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:44.364189 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 467/936] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:44.369475 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455645-7466-4430-9a28-5b60169e1976 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:44.369898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455645-7466-4430-9a28-5b60169e1976 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:44.370105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02455645-7466-4430-9a28-5b60169e1976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:44.408034 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-02455645-7466-4430-9a28-5b60169e1976 None None] MFA Rules not processed for user `77ac4ae6d3af4243af797ace724b7e68`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:44.409730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-02455645-7466-4430-9a28-5b60169e1976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:44.453302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=100 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:34:44.482548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 470/937] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:44 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:44.523258 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59a8b-7637-49d3-8f9b-de9466753c5b None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:44.534325 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59a8b-7637-49d3-8f9b-de9466753c5b None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:44.537963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771462b-e0f5-453c-8f52-305c0190a990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:44.538683 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771462b-e0f5-453c-8f52-305c0190a990 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:44.539166 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771462b-e0f5-453c-8f52-305c0190a990 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:44.539520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771462b-e0f5-453c-8f52-305c0190a990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:44.551087 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771462b-e0f5-453c-8f52-305c0190a990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:44.553841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771462b-e0f5-453c-8f52-305c0190a990 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:44.564553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 468/938] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:44 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:34:47.453629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da66df-1b89-4010-8c6e-8fe110b3d5b7 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:47.454116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da66df-1b89-4010-8c6e-8fe110b3d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:47.454204 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da66df-1b89-4010-8c6e-8fe110b3d5b7 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:47.455710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 471/939] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:47.460801 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951342e-52cb-489e-8ca9-778bdbb16578 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:47.461256 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951342e-52cb-489e-8ca9-778bdbb16578 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:47.461491 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951342e-52cb-489e-8ca9-778bdbb16578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:47.478926 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e951342e-52cb-489e-8ca9-778bdbb16578 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:47.480172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e951342e-52cb-489e-8ca9-778bdbb16578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:47.553773 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 469/940] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:47 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:47.593347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da66df-1b89-4010-8c6e-8fe110b3d5b7 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:47.603870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da66df-1b89-4010-8c6e-8fe110b3d5b7 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:47.607954 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8a537-1057-4827-b32a-2bb833aee8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:47.608585 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a537-1057-4827-b32a-2bb833aee8af service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:47.608871 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a537-1057-4827-b32a-2bb833aee8af service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:47.609151 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a537-1057-4827-b32a-2bb833aee8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:47.617881 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8a537-1057-4827-b32a-2bb833aee8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:47.619307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8a537-1057-4827-b32a-2bb833aee8af service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:47.629352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 472/941] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:47 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:50.526777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad99d-597f-4153-8061-96869676361f None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:50.527373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad99d-597f-4153-8061-96869676361f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:50.527373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fad99d-597f-4153-8061-96869676361f None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:50.528801 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 470/942] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:50.534509 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb77462-c447-409b-bf5d-ff7c0ef4f240 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:50.534959 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb77462-c447-409b-bf5d-ff7c0ef4f240 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:50.535070 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb77462-c447-409b-bf5d-ff7c0ef4f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:50.552683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6cb77462-c447-409b-bf5d-ff7c0ef4f240 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:50.553890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6cb77462-c447-409b-bf5d-ff7c0ef4f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:50.562111 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 473/943] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:50.598907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad99d-597f-4153-8061-96869676361f None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:50.610029 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fad99d-597f-4153-8061-96869676361f None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:50.613883 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5574-0c24-4e2f-87d1-5dc1bb5a17eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:50.614728 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5574-0c24-4e2f-87d1-5dc1bb5a17eb service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:50.615255 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5574-0c24-4e2f-87d1-5dc1bb5a17eb service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:50.615604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5574-0c24-4e2f-87d1-5dc1bb5a17eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:50.625117 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5574-0c24-4e2f-87d1-5dc1bb5a17eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:50.626546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5574-0c24-4e2f-87d1-5dc1bb5a17eb service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:50.635865 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 471/944] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:52.920304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb149d1-0923-4f40-9712-0ed5075684c0 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:52.920854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb149d1-0923-4f40-9712-0ed5075684c0 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:52.920854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb149d1-0923-4f40-9712-0ed5075684c0 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:52.922173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 474/945] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:52.927386 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e067f-63a5-4bfe-9723-f12611fc759b None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:52.927850 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e067f-63a5-4bfe-9723-f12611fc759b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:52.928009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e067f-63a5-4bfe-9723-f12611fc759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:52.945652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8b3e067f-63a5-4bfe-9723-f12611fc759b None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:52.946841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8b3e067f-63a5-4bfe-9723-f12611fc759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:52.954713 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 472/946] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:53.007165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84de0-acfc-4e12-b4b2-b2d9ec22842d None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:53.007476 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84de0-acfc-4e12-b4b2-b2d9ec22842d None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:53.007789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84de0-acfc-4e12-b4b2-b2d9ec22842d None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:53.009164 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 475/947] 10.222.0.94 () {54 vars in 964 bytes} [Fri Jul 15 15:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:53.015848 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92263-7368-4470-a41e-0f2e50549076 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:53.016143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92263-7368-4470-a41e-0f2e50549076 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:53.016423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92263-7368-4470-a41e-0f2e50549076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:53.034842 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-25e92263-7368-4470-a41e-0f2e50549076 None None] MFA Rules not processed for user `8a31482a8d184d81a5569d11fcc53181`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:53.036063 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-25e92263-7368-4470-a41e-0f2e50549076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:53.042397 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 473/948] 10.222.0.94 () {58 vars in 1061 bytes} [Fri Jul 15 15:34:53 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:34:53.051886 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c84de0-acfc-4e12-b4b2-b2d9ec22842d None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:53.062512 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c84de0-acfc-4e12-b4b2-b2d9ec22842d None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:53.065999 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb829a93-a2d9-4f7e-ab4f-af1ff2058663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:53.066712 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb829a93-a2d9-4f7e-ab4f-af1ff2058663 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:53.066996 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb829a93-a2d9-4f7e-ab4f-af1ff2058663 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:53.067275 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb829a93-a2d9-4f7e-ab4f-af1ff2058663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:53.076480 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb829a93-a2d9-4f7e-ab4f-af1ff2058663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:53.077907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb829a93-a2d9-4f7e-ab4f-af1ff2058663 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:53.087257 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 476/949] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:55.582480 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd24d-6177-42d6-b3d1-0bc39c69fe6b None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:55.582990 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd24d-6177-42d6-b3d1-0bc39c69fe6b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:55.583099 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd24d-6177-42d6-b3d1-0bc39c69fe6b None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:55.584458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 474/950] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:55.589579 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f01ca-725c-4f5c-840c-ac2ce72ca8d1 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:55.589978 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f01ca-725c-4f5c-840c-ac2ce72ca8d1 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:55.590144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f01ca-725c-4f5c-840c-ac2ce72ca8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:55.608907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-d45f01ca-725c-4f5c-840c-ac2ce72ca8d1 None None] MFA Rules not processed for user `77ac4ae6d3af4243af797ace724b7e68`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:55.613108 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-d45f01ca-725c-4f5c-840c-ac2ce72ca8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:55.625699 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 477/951] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:55 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:55.664926 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afd24d-6177-42d6-b3d1-0bc39c69fe6b None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:55.675898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afd24d-6177-42d6-b3d1-0bc39c69fe6b None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:55.679283 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14b677-694a-4479-8361-27b8d1707eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:55.679960 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b677-694a-4479-8361-27b8d1707eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:55.680246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b677-694a-4479-8361-27b8d1707eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:55.680524 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14b677-694a-4479-8361-27b8d1707eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:55.689624 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14b677-694a-4479-8361-27b8d1707eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:55.691184 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14b677-694a-4479-8361-27b8d1707eb3 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:55.700686 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 475/952] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:55 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:34:58.361552 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b315-ca1b-4676-b8f6-e1e163cb05fa None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:58.362074 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b315-ca1b-4676-b8f6-e1e163cb05fa None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:58.362170 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b315-ca1b-4676-b8f6-e1e163cb05fa None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:58.363478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 478/953] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:34:58.368856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0effb4-e2a0-4005-aec2-21d803d1aa14 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:58.369285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0effb4-e2a0-4005-aec2-21d803d1aa14 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:58.369423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0effb4-e2a0-4005-aec2-21d803d1aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:58.387107 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-fe0effb4-e2a0-4005-aec2-21d803d1aa14 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:34:58.388333 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-fe0effb4-e2a0-4005-aec2-21d803d1aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:34:58.396158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 476/954] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:34:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:34:58.433244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b315-ca1b-4676-b8f6-e1e163cb05fa None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:34:58.444031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b315-ca1b-4676-b8f6-e1e163cb05fa None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:34:58.447500 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fba3ba-ab82-46f8-9df1-6188edd67a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:34:58.448169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba3ba-ab82-46f8-9df1-6188edd67a61 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:34:58.448460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba3ba-ab82-46f8-9df1-6188edd67a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:34:58.448739 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba3ba-ab82-46f8-9df1-6188edd67a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:34:58.457679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fba3ba-ab82-46f8-9df1-6188edd67a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:34:58.459051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fba3ba-ab82-46f8-9df1-6188edd67a61 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:34:58.468994 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 479/955] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:34:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:00.757640 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d204a-2bbb-4893-b944-b79fa0a5b82e None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:00.758190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d204a-2bbb-4893-b944-b79fa0a5b82e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:00.758190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d204a-2bbb-4893-b944-b79fa0a5b82e None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:00.759577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 477/956] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:35:00.765625 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b83ac-0fa0-4507-884e-49837dd17d5a None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:00.766047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b83ac-0fa0-4507-884e-49837dd17d5a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:00.766247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b83ac-0fa0-4507-884e-49837dd17d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:00.784353 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-aa0b83ac-0fa0-4507-884e-49837dd17d5a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:00.785533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-aa0b83ac-0fa0-4507-884e-49837dd17d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:00.793272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 480/957] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:00.833471 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d204a-2bbb-4893-b944-b79fa0a5b82e None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:00.838907 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=68 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:00.846196 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d204a-2bbb-4893-b944-b79fa0a5b82e None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:00.849717 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644fe6-26b7-4777-918e-4ad2750354c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:00.850357 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644fe6-26b7-4777-918e-4ad2750354c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:00.850644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644fe6-26b7-4777-918e-4ad2750354c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:00.850925 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644fe6-26b7-4777-918e-4ad2750354c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:00.860821 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644fe6-26b7-4777-918e-4ad2750354c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:00.862288 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644fe6-26b7-4777-918e-4ad2750354c4 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:00.873188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 478/958] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:03.600973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccb023-61f7-42f7-add9-8fd38842c66c None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:03.601519 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccb023-61f7-42f7-add9-8fd38842c66c None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:03.601519 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccb023-61f7-42f7-add9-8fd38842c66c None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:03.602913 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 481/959] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:03.608212 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff04e1-d0a6-4832-bf0c-6bbfd9fc7944 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:03.609316 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff04e1-d0a6-4832-bf0c-6bbfd9fc7944 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:03.609445 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff04e1-d0a6-4832-bf0c-6bbfd9fc7944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:03.626818 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f1ff04e1-d0a6-4832-bf0c-6bbfd9fc7944 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:03.628035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f1ff04e1-d0a6-4832-bf0c-6bbfd9fc7944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:03.635677 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 479/960] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:03 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:03.673772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccb023-61f7-42f7-add9-8fd38842c66c None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:03.684304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccb023-61f7-42f7-add9-8fd38842c66c None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:03.687832 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e714bab-8a22-4016-94e7-0068b0be5ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:03.688472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e714bab-8a22-4016-94e7-0068b0be5ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:03.688763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e714bab-8a22-4016-94e7-0068b0be5ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:03.689071 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e714bab-8a22-4016-94e7-0068b0be5ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:03.697943 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e714bab-8a22-4016-94e7-0068b0be5ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:03.699457 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e714bab-8a22-4016-94e7-0068b0be5ff4 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:03.708858 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 482/961] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:03 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:07.990814 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ffe3-bd27-4294-aa51-435673429c03 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:07.991246 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ffe3-bd27-4294-aa51-435673429c03 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:07.991385 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4ffe3-bd27-4294-aa51-435673429c03 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:07.992823 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 480/962] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:07.997895 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f348ff-ee94-4467-b32c-d20dadb6a0ea None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:07.998312 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f348ff-ee94-4467-b32c-d20dadb6a0ea None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:07.998572 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f348ff-ee94-4467-b32c-d20dadb6a0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:08.017485 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-d6f348ff-ee94-4467-b32c-d20dadb6a0ea None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:08.018682 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-d6f348ff-ee94-4467-b32c-d20dadb6a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:08.026579 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 483/963] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:08.066459 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4ffe3-bd27-4294-aa51-435673429c03 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:08.077157 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4ffe3-bd27-4294-aa51-435673429c03 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:08.080738 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ded2bb-6eb1-4bc5-9ff7-f67637b620ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:08.081374 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded2bb-6eb1-4bc5-9ff7-f67637b620ab service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:08.081664 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded2bb-6eb1-4bc5-9ff7-f67637b620ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:08.081944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded2bb-6eb1-4bc5-9ff7-f67637b620ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:08.090874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ded2bb-6eb1-4bc5-9ff7-f67637b620ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:08.092338 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ded2bb-6eb1-4bc5-9ff7-f67637b620ab service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:08.102481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 481/964] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:10.995155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0716ec-8c25-4d7f-8ee6-1206e1bde043 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:10.995657 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0716ec-8c25-4d7f-8ee6-1206e1bde043 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:10.995870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0716ec-8c25-4d7f-8ee6-1206e1bde043 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:10.997129 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 484/965] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:11.003289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca07b47-f702-4776-ba79-4b7b3b17c9b7 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:11.003729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca07b47-f702-4776-ba79-4b7b3b17c9b7 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:11.003902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca07b47-f702-4776-ba79-4b7b3b17c9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:11.022035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-eca07b47-f702-4776-ba79-4b7b3b17c9b7 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:11.023503 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-eca07b47-f702-4776-ba79-4b7b3b17c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:11.031363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 482/966] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:11 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:11.069374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0716ec-8c25-4d7f-8ee6-1206e1bde043 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:11.080544 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0716ec-8c25-4d7f-8ee6-1206e1bde043 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:11.084072 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5648c-fb31-4110-8d53-4d2d4864d6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:11.084705 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5648c-fb31-4110-8d53-4d2d4864d6de service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:11.084984 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5648c-fb31-4110-8d53-4d2d4864d6de service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:11.085256 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5648c-fb31-4110-8d53-4d2d4864d6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:11.094463 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5648c-fb31-4110-8d53-4d2d4864d6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:11.095932 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5648c-fb31-4110-8d53-4d2d4864d6de service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:11.105483 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 485/967] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:11 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:15.533706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911061-efb8-4f31-97cd-73f024f29759 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:15.534212 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911061-efb8-4f31-97cd-73f024f29759 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:15.534301 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911061-efb8-4f31-97cd-73f024f29759 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:15.535643 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 483/968] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:15.540715 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0910-c3a4-4f2c-9b54-0870b50fbdc8 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:15.541101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0910-c3a4-4f2c-9b54-0870b50fbdc8 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:15.541285 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b0910-c3a4-4f2c-9b54-0870b50fbdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:15.547314 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=54 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:15.559998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-a89b0910-c3a4-4f2c-9b54-0870b50fbdc8 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:15.561187 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-a89b0910-c3a4-4f2c-9b54-0870b50fbdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:15.569651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 486/969] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:15.608995 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9911061-efb8-4f31-97cd-73f024f29759 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:15.619715 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9911061-efb8-4f31-97cd-73f024f29759 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:15.623241 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb06cd-9da0-43f7-8e90-3ce15063c769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:15.623918 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb06cd-9da0-43f7-8e90-3ce15063c769 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:15.624208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb06cd-9da0-43f7-8e90-3ce15063c769 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:15.624514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb06cd-9da0-43f7-8e90-3ce15063c769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:15.634564 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb06cd-9da0-43f7-8e90-3ce15063c769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:15.635966 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb06cd-9da0-43f7-8e90-3ce15063c769 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:15.645869 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 484/970] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:21.065166 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2341c-8a21-41f8-a327-523c66f2a58f None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:21.065595 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2341c-8a21-41f8-a327-523c66f2a58f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:21.066058 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2341c-8a21-41f8-a327-523c66f2a58f None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:21.067206 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 487/971] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:21.073014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2c365-d690-46f7-8682-ae47cf52f571 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:21.073446 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2c365-d690-46f7-8682-ae47cf52f571 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:21.073584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2c365-d690-46f7-8682-ae47cf52f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:21.166243 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-4db2c365-d690-46f7-8682-ae47cf52f571 None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:21.167465 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-4db2c365-d690-46f7-8682-ae47cf52f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:21.295318 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 485/972] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:35:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:35:25.554536 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=2 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:25.640570 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eda15e-e8d9-4222-b1e1-85660df2c305 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:25.641065 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eda15e-e8d9-4222-b1e1-85660df2c305 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:25.641549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eda15e-e8d9-4222-b1e1-85660df2c305 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:25.644633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 488/973] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:35:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:25.649597 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452305f-d9e8-40a4-9313-f9f64a38edfa None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:25.650412 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452305f-d9e8-40a4-9313-f9f64a38edfa None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:25.650835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452305f-d9e8-40a4-9313-f9f64a38edfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:25.669524 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-1452305f-d9e8-40a4-9313-f9f64a38edfa None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:25.670971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-1452305f-d9e8-40a4-9313-f9f64a38edfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:25.681438 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 486/974] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:35:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:27.314568 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249ba6-31c1-472c-805d-fbcc4cbb4d7e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:27.315124 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249ba6-31c1-472c-805d-fbcc4cbb4d7e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:27.315286 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e249ba6-31c1-472c-805d-fbcc4cbb4d7e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:27.317297 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 489/975] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:27.322594 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5a28-47e5-4e40-89e0-a3741105a23f None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:27.323070 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5a28-47e5-4e40-89e0-a3741105a23f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:27.323163 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f5a28-47e5-4e40-89e0-a3741105a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:27.345073 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e53f5a28-47e5-4e40-89e0-a3741105a23f None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:27.346278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e53f5a28-47e5-4e40-89e0-a3741105a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:27.355132 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 487/976] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:35:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:31.351511 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16030c3-7b27-4657-a0ce-7a83d86396c4 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:31.352075 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16030c3-7b27-4657-a0ce-7a83d86396c4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:31.352181 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16030c3-7b27-4657-a0ce-7a83d86396c4 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:31.353453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 490/977] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:31.358774 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830949-456e-4894-ae62-998865c0bb59 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:31.359194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830949-456e-4894-ae62-998865c0bb59 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:31.359324 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830949-456e-4894-ae62-998865c0bb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:31.366542 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=69 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:31.379913 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-be830949-456e-4894-ae62-998865c0bb59 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:31.381250 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-be830949-456e-4894-ae62-998865c0bb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:31.389511 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 488/978] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:31.447291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4996-41d5-4dfa-9339-08b5c4e9d3d2 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:31.448285 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4996-41d5-4dfa-9339-08b5c4e9d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:31.448848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4996-41d5-4dfa-9339-08b5c4e9d3d2 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:31.450401 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 491/979] 10.222.0.94 () {54 vars in 961 bytes} [Fri Jul 15 15:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:31.459535 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812fed-ce38-4e53-8f47-64ae29ae9201 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:31.460177 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812fed-ce38-4e53-8f47-64ae29ae9201 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:31.460659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812fed-ce38-4e53-8f47-64ae29ae9201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:31.497768 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8b812fed-ce38-4e53-8f47-64ae29ae9201 None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:31.499940 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8b812fed-ce38-4e53-8f47-64ae29ae9201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:31.576927 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 489/980] 10.222.0.94 () {58 vars in 1058 bytes} [Fri Jul 15 15:35:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:31.584574 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4996-41d5-4dfa-9339-08b5c4e9d3d2 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:31.597790 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4996-41d5-4dfa-9339-08b5c4e9d3d2 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:31.602743 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ceba-d673-4f68-8e94-a84231620db4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:31.603474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ceba-d673-4f68-8e94-a84231620db4 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:31.603900 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ceba-d673-4f68-8e94-a84231620db4 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:31.604294 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ceba-d673-4f68-8e94-a84231620db4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:31.613247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ceba-d673-4f68-8e94-a84231620db4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:31.614846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ceba-d673-4f68-8e94-a84231620db4 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:31.624528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 492/981] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:34.090530 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d370c8-5c90-4c90-9793-fb3c720cbe90 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:34.091081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d370c8-5c90-4c90-9793-fb3c720cbe90 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:34.091081 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d370c8-5c90-4c90-9793-fb3c720cbe90 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:34.092639 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 490/982] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:34.098398 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de78de-b466-4181-a216-2702ec07d686 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:34.098782 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de78de-b466-4181-a216-2702ec07d686 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:34.098956 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de78de-b466-4181-a216-2702ec07d686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:34.116726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-e8de78de-b466-4181-a216-2702ec07d686 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:34.118151 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-e8de78de-b466-4181-a216-2702ec07d686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:34.126106 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 493/983] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:34.171941 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d370c8-5c90-4c90-9793-fb3c720cbe90 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:34.186279 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d370c8-5c90-4c90-9793-fb3c720cbe90 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:34.192019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314c7f6-11e0-4150-90f7-2cb4d5fd41fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:34.192665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c7f6-11e0-4150-90f7-2cb4d5fd41fc service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:34.193063 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c7f6-11e0-4150-90f7-2cb4d5fd41fc service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:34.193351 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314c7f6-11e0-4150-90f7-2cb4d5fd41fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:34.202072 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314c7f6-11e0-4150-90f7-2cb4d5fd41fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:34.203701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314c7f6-11e0-4150-90f7-2cb4d5fd41fc service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:34.215902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 491/984] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:36.789952 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886485-3a4b-486c-b207-beb45a772d64 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:36.790493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886485-3a4b-486c-b207-beb45a772d64 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:36.790493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886485-3a4b-486c-b207-beb45a772d64 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:36.791877 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 494/985] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:36.797142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1231aa-03a3-4e78-8d0c-be490448dd5c None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:36.797524 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1231aa-03a3-4e78-8d0c-be490448dd5c None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:36.797700 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1231aa-03a3-4e78-8d0c-be490448dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:36.815865 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-cd1231aa-03a3-4e78-8d0c-be490448dd5c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:36.817115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-cd1231aa-03a3-4e78-8d0c-be490448dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:36.832481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 492/986] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:36.880711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccc99a-dbcf-496f-ab8e-6dbe05865574 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:36.881082 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccc99a-dbcf-496f-ab8e-6dbe05865574 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:36.881396 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccc99a-dbcf-496f-ab8e-6dbe05865574 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:36.882808 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 495/987] 10.222.0.94 () {54 vars in 961 bytes} [Fri Jul 15 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:36.889150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9a96e-e3f8-4406-9ff8-5bf38c01a79d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:36.889454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9a96e-e3f8-4406-9ff8-5bf38c01a79d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:36.889738 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9a96e-e3f8-4406-9ff8-5bf38c01a79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:36.908165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-45f9a96e-e3f8-4406-9ff8-5bf38c01a79d None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:36.911838 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-45f9a96e-e3f8-4406-9ff8-5bf38c01a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:36.919354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 493/988] 10.222.0.94 () {58 vars in 1058 bytes} [Fri Jul 15 15:35:36 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:36.927434 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccc99a-dbcf-496f-ab8e-6dbe05865574 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:36.942710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccc99a-dbcf-496f-ab8e-6dbe05865574 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:36.947704 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f684c0-4729-4e39-a977-5a985ae8c897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:36.948495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f684c0-4729-4e39-a977-5a985ae8c897 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:36.948785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f684c0-4729-4e39-a977-5a985ae8c897 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:36.949066 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f684c0-4729-4e39-a977-5a985ae8c897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:36.958067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f684c0-4729-4e39-a977-5a985ae8c897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:36.961132 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f684c0-4729-4e39-a977-5a985ae8c897 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:36.970764 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 496/989] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:39.304645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c40dd-af30-455c-993d-abd13c1fe21e None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:39.305996 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c40dd-af30-455c-993d-abd13c1fe21e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:39.306517 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c40dd-af30-455c-993d-abd13c1fe21e None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:39.309424 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 494/990] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:39.314867 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e5ef5-1751-41ec-9fcb-9acf78e1ff2a None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:39.315709 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e5ef5-1751-41ec-9fcb-9acf78e1ff2a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:39.316174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e5ef5-1751-41ec-9fcb-9acf78e1ff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:39.343265 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-d86e5ef5-1751-41ec-9fcb-9acf78e1ff2a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:39.345003 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-d86e5ef5-1751-41ec-9fcb-9acf78e1ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:39.355015 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 497/991] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:39.405331 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c40dd-af30-455c-993d-abd13c1fe21e None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:39.422541 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c40dd-af30-455c-993d-abd13c1fe21e None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:39.428308 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7d5d6-2b6b-4288-b3dd-f35123c79cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:39.429206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d5d6-2b6b-4288-b3dd-f35123c79cee service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:39.429950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d5d6-2b6b-4288-b3dd-f35123c79cee service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:39.430495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7d5d6-2b6b-4288-b3dd-f35123c79cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:39.442800 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7d5d6-2b6b-4288-b3dd-f35123c79cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:39.445525 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7d5d6-2b6b-4288-b3dd-f35123c79cee service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:39.457518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 495/992] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:41.589557 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6f79d-4b19-45bd-a89c-4bedc18b1573 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:41.590108 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6f79d-4b19-45bd-a89c-4bedc18b1573 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:41.590108 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6f79d-4b19-45bd-a89c-4bedc18b1573 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:41.591465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 498/993] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:41.596828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc2f9-a57b-4a39-bb9d-97360a9445e4 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:41.597221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc2f9-a57b-4a39-bb9d-97360a9445e4 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:41.597378 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc2f9-a57b-4a39-bb9d-97360a9445e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:41.616008 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e33cc2f9-a57b-4a39-bb9d-97360a9445e4 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:41.617195 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e33cc2f9-a57b-4a39-bb9d-97360a9445e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:41.625049 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 496/994] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:41.853767 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e427-9204-475a-9fbe-5779c0504523 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:41.854795 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e427-9204-475a-9fbe-5779c0504523 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:41.855469 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39e427-9204-475a-9fbe-5779c0504523 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:41.857351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 499/995] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:41.862380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1c92-4626-4fbc-827e-99933ddc8672 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:41.862933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1c92-4626-4fbc-827e-99933ddc8672 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:41.863440 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1c92-4626-4fbc-827e-99933ddc8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:41.885952 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7e2e1c92-4626-4fbc-827e-99933ddc8672 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:41.887628 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7e2e1c92-4626-4fbc-827e-99933ddc8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:41.899960 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 497/996] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:35:41.939266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc4797-f338-46fa-83c6-cd03e7bb3457 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:41.940437 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc4797-f338-46fa-83c6-cd03e7bb3457 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:41.940655 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc4797-f338-46fa-83c6-cd03e7bb3457 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:41.942883 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 500/997] 10.222.0.94 () {54 vars in 963 bytes} [Fri Jul 15 15:35:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:41.948743 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6cab-0f68-4740-bfb7-0860d4933c49 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:41.949290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6cab-0f68-4740-bfb7-0860d4933c49 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:41.949695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc4797-f338-46fa-83c6-cd03e7bb3457 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:41.949833 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc6cab-0f68-4740-bfb7-0860d4933c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:41.966686 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc4797-f338-46fa-83c6-cd03e7bb3457 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:41.973697 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:41.974369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:41.974868 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:41.975329 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:41.985898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:41.987582 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:41.997774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 501/998] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:41.998915 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-59fc6cab-0f68-4740-bfb7-0860d4933c49 None None] MFA Rules not processed for user `5904a25265304dc683441c3b110bd1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:42.000337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-59fc6cab-0f68-4740-bfb7-0860d4933c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:42.077590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 498/999] 10.222.0.94 () {58 vars in 1060 bytes} [Fri Jul 15 15:35:41 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:42.086028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:42.096066 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ceabf4-da39-4e04-97be-437383db3157 service nova] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:42.100637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadbbf8-c491-43a2-857d-a4db96377b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5904a25265304dc683441c3b110bd1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:42.101315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadbbf8-c491-43a2-857d-a4db96377b09 service cinder] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:42.101590 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadbbf8-c491-43a2-857d-a4db96377b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:42.101872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadbbf8-c491-43a2-857d-a4db96377b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:42.112559 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadbbf8-c491-43a2-857d-a4db96377b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:42.113981 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadbbf8-c491-43a2-857d-a4db96377b09 service cinder] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:42.126210 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 502/1000] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:44.309102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616548b1-d4c7-4ff6-bcf9-9e1aa7fe6395 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:44.309102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616548b1-d4c7-4ff6-bcf9-9e1aa7fe6395 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:44.309665 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616548b1-d4c7-4ff6-bcf9-9e1aa7fe6395 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:44.311341 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 499/1001] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:44.317535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856c36-f070-4aed-b83f-ae1648427d83 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:44.318344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856c36-f070-4aed-b83f-ae1648427d83 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:44.318633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de856c36-f070-4aed-b83f-ae1648427d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:44.337474 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-de856c36-f070-4aed-b83f-ae1648427d83 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:44.338686 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-de856c36-f070-4aed-b83f-ae1648427d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:44.348534 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 503/1002] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:44.395537 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616548b1-d4c7-4ff6-bcf9-9e1aa7fe6395 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:44.405036 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:44.410748 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616548b1-d4c7-4ff6-bcf9-9e1aa7fe6395 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:44.418160 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd43a4-6e40-4b61-bd56-20fb9291c888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:44.418813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd43a4-6e40-4b61-bd56-20fb9291c888 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:44.419102 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd43a4-6e40-4b61-bd56-20fb9291c888 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:44.419386 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd43a4-6e40-4b61-bd56-20fb9291c888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:44.428621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd43a4-6e40-4b61-bd56-20fb9291c888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:44.430229 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd43a4-6e40-4b61-bd56-20fb9291c888 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:44.440608 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 500/1003] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:46.731467 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a57a4-d411-4a80-9c3a-8a9637872a32 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:46.732515 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a57a4-d411-4a80-9c3a-8a9637872a32 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:46.732833 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a57a4-d411-4a80-9c3a-8a9637872a32 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:46.734348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 504/1004] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:46.741125 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a66dd-1cef-4778-8134-8c1cbd70a880 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:46.741674 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a66dd-1cef-4778-8134-8c1cbd70a880 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:46.741674 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a66dd-1cef-4778-8134-8c1cbd70a880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:46.761657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-905a66dd-1cef-4778-8134-8c1cbd70a880 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:46.763342 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-905a66dd-1cef-4778-8134-8c1cbd70a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:46.775849 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 501/1005] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:46.815323 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a57a4-d411-4a80-9c3a-8a9637872a32 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:46.830493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a57a4-d411-4a80-9c3a-8a9637872a32 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:46.835776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461caf2-c940-4746-92fa-eb798fda9700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:46.836637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461caf2-c940-4746-92fa-eb798fda9700 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:46.837077 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461caf2-c940-4746-92fa-eb798fda9700 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:46.837524 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461caf2-c940-4746-92fa-eb798fda9700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:46.846514 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461caf2-c940-4746-92fa-eb798fda9700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:46.848361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461caf2-c940-4746-92fa-eb798fda9700 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:46.858638 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 505/1006] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:49.121547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111eba-0c08-4125-8374-eb50d771c913 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:49.121902 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111eba-0c08-4125-8374-eb50d771c913 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:49.122173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111eba-0c08-4125-8374-eb50d771c913 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:49.123659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 502/1007] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:49.129823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20c0f-d986-4dd4-bb6b-aa1e98a5b7d2 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:49.130205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20c0f-d986-4dd4-bb6b-aa1e98a5b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:49.130430 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde20c0f-d986-4dd4-bb6b-aa1e98a5b7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:49.153173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-bde20c0f-d986-4dd4-bb6b-aa1e98a5b7d2 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:49.154351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-bde20c0f-d986-4dd4-bb6b-aa1e98a5b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:49.164221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 506/1008] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:49.208442 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111eba-0c08-4125-8374-eb50d771c913 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:49.222303 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111eba-0c08-4125-8374-eb50d771c913 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:49.228093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b54f2-9c92-461e-a971-02b3f5a2a1c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:49.228652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b54f2-9c92-461e-a971-02b3f5a2a1c9 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:49.228938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b54f2-9c92-461e-a971-02b3f5a2a1c9 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:49.229215 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b54f2-9c92-461e-a971-02b3f5a2a1c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:49.242047 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b54f2-9c92-461e-a971-02b3f5a2a1c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:49.243644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b54f2-9c92-461e-a971-02b3f5a2a1c9 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:49.255920 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 503/1009] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:52.005094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265ed7-d56d-4eda-8ca4-27d046e51275 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:52.005650 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265ed7-d56d-4eda-8ca4-27d046e51275 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:52.005650 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d265ed7-d56d-4eda-8ca4-27d046e51275 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:52.007013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 507/1010] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:35:52.013478 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12bff-6c18-4df1-99ec-863e53974fc0 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:52.013938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12bff-6c18-4df1-99ec-863e53974fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:52.014043 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12bff-6c18-4df1-99ec-863e53974fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:52.032539 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f4f12bff-6c18-4df1-99ec-863e53974fc0 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:52.033760 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f4f12bff-6c18-4df1-99ec-863e53974fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:52.042500 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 504/1011] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:52.091355 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265ed7-d56d-4eda-8ca4-27d046e51275 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:52.109418 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d265ed7-d56d-4eda-8ca4-27d046e51275 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:52.115794 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba03f-a261-4155-b04b-af41186693d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:52.116618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba03f-a261-4155-b04b-af41186693d9 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:52.116978 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba03f-a261-4155-b04b-af41186693d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:52.117349 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba03f-a261-4155-b04b-af41186693d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:52.128976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba03f-a261-4155-b04b-af41186693d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:52.131452 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba03f-a261-4155-b04b-af41186693d9 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:52.144582 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 508/1012] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:54.708526 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61602-d23a-4f32-88cc-00965fc0ec4b None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:54.709286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61602-d23a-4f32-88cc-00965fc0ec4b None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:54.709574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61602-d23a-4f32-88cc-00965fc0ec4b None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:54.710982 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 505/1013] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:54.716407 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6c3fd-ecc2-40d9-8a89-e1dff507262d None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:54.717001 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6c3fd-ecc2-40d9-8a89-e1dff507262d None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:54.717001 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6c3fd-ecc2-40d9-8a89-e1dff507262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:54.734810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-74a6c3fd-ecc2-40d9-8a89-e1dff507262d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:54.736083 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-74a6c3fd-ecc2-40d9-8a89-e1dff507262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:54.744125 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 509/1014] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:54.791967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e61602-d23a-4f32-88cc-00965fc0ec4b None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:54.808916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e61602-d23a-4f32-88cc-00965fc0ec4b None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:54.814896 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1efea1-e83b-47ce-a59c-6ba983b295e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:54.815921 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efea1-e83b-47ce-a59c-6ba983b295e0 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:54.816906 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efea1-e83b-47ce-a59c-6ba983b295e0 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:54.817188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efea1-e83b-47ce-a59c-6ba983b295e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:54.827560 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1efea1-e83b-47ce-a59c-6ba983b295e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:54.829602 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1efea1-e83b-47ce-a59c-6ba983b295e0 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:54.841701 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 506/1015] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:57.839245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036a6d-2a41-436e-8646-8f1dcab3ff76 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:57.839968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036a6d-2a41-436e-8646-8f1dcab3ff76 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:57.839968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb036a6d-2a41-436e-8646-8f1dcab3ff76 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:57.841193 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 510/1016] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:57.846518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2084b-f9bf-4833-837a-8c636ea578be None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:57.847015 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2084b-f9bf-4833-837a-8c636ea578be None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:57.847128 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2084b-f9bf-4833-837a-8c636ea578be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:57.866545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-72f2084b-f9bf-4833-837a-8c636ea578be None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:57.867727 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-72f2084b-f9bf-4833-837a-8c636ea578be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:57.875634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 507/1017] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:57.923268 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036a6d-2a41-436e-8646-8f1dcab3ff76 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:57.932001 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=52 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:35:57.939813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb036a6d-2a41-436e-8646-8f1dcab3ff76 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:57.946230 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3aa5f-96f9-4361-9235-eff75d0b0551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:57.946889 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3aa5f-96f9-4361-9235-eff75d0b0551 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:57.947176 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3aa5f-96f9-4361-9235-eff75d0b0551 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:57.947456 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3aa5f-96f9-4361-9235-eff75d0b0551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:57.956589 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3aa5f-96f9-4361-9235-eff75d0b0551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:57.958510 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3aa5f-96f9-4361-9235-eff75d0b0551 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:57.968440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 511/1018] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:35:58.081259 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057b03-9fc3-4871-96ef-320bdedea803 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:58.081576 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057b03-9fc3-4871-96ef-320bdedea803 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:58.081864 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85057b03-9fc3-4871-96ef-320bdedea803 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:58.083455 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 508/1019] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:35:58.089450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caba76-6d4c-445e-8ff8-b5a34bfd75b7 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:58.089669 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caba76-6d4c-445e-8ff8-b5a34bfd75b7 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:58.089958 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caba76-6d4c-445e-8ff8-b5a34bfd75b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:58.109318 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-82caba76-6d4c-445e-8ff8-b5a34bfd75b7 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:58.110605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-82caba76-6d4c-445e-8ff8-b5a34bfd75b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:58.119408 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 512/1020] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:35:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:58.179836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ab182-3f74-4130-a265-8ecd4d6bbcf9 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:58.180131 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ab182-3f74-4130-a265-8ecd4d6bbcf9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:58.180418 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ab182-3f74-4130-a265-8ecd4d6bbcf9 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:58.182157 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 509/1021] 10.222.0.94 () {54 vars in 960 bytes} [Fri Jul 15 15:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:35:58.187450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cafe6-dee8-42d6-9fad-6ac6c3f1e110 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:58.187757 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cafe6-dee8-42d6-9fad-6ac6c3f1e110 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:58.188051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cafe6-dee8-42d6-9fad-6ac6c3f1e110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:58.226081 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-3d9cafe6-dee8-42d6-9fad-6ac6c3f1e110 None None] MFA Rules not processed for user `4c96f27d72744e5fb22cbe798a0cb98e`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:35:58.227294 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-3d9cafe6-dee8-42d6-9fad-6ac6c3f1e110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:35:58.304575 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 513/1022] 10.222.0.94 () {58 vars in 1057 bytes} [Fri Jul 15 15:35:58 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:35:58.304750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ab182-3f74-4130-a265-8ecd4d6bbcf9 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:35:58.310659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ab182-3f74-4130-a265-8ecd4d6bbcf9 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:35:58.314355 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f2649-2fad-405a-b4b8-2527a385d606 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c96f27d72744e5fb22cbe798a0cb98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:35:58.314994 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f2649-2fad-405a-b4b8-2527a385d606 service glance] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:35:58.315823 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f2649-2fad-405a-b4b8-2527a385d606 service glance] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:35:58.316193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f2649-2fad-405a-b4b8-2527a385d606 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:35:58.326502 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f2649-2fad-405a-b4b8-2527a385d606 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:35:58.327963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f2649-2fad-405a-b4b8-2527a385d606 service glance] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:35:58.337978 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 510/1023] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:35:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:00.274638 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9bbed-e074-47ad-b71c-417695914eae None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:00.275327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9bbed-e074-47ad-b71c-417695914eae None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:00.275327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9bbed-e074-47ad-b71c-417695914eae None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:00.276636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 514/1024] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:00.284002 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7eda-5d89-4981-b1d7-a75b78d37c2a None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:00.284547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7eda-5d89-4981-b1d7-a75b78d37c2a None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:00.284547 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7eda-5d89-4981-b1d7-a75b78d37c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:00.303274 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-10ec7eda-5d89-4981-b1d7-a75b78d37c2a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:00.304515 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-10ec7eda-5d89-4981-b1d7-a75b78d37c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:00.313616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 511/1025] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:36:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:00.376057 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9bbed-e074-47ad-b71c-417695914eae None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:00.390326 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9bbed-e074-47ad-b71c-417695914eae None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:00.395379 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dac33-a8a6-4755-9a4c-abd13c732cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:00.396042 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dac33-a8a6-4755-9a4c-abd13c732cf0 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:00.396332 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dac33-a8a6-4755-9a4c-abd13c732cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:00.396610 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dac33-a8a6-4755-9a4c-abd13c732cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:00.405442 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dac33-a8a6-4755-9a4c-abd13c732cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:00.407040 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dac33-a8a6-4755-9a4c-abd13c732cf0 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:00.417313 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 515/1026] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:10.297463 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=34 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:10.413023 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=47 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:13.798988 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147078a7-20ce-499e-b77b-883d006aa3b7 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:13.799640 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147078a7-20ce-499e-b77b-883d006aa3b7 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:13.799640 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147078a7-20ce-499e-b77b-883d006aa3b7 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:13.800962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 512/1027] 10.222.0.94 () {54 vars in 918 bytes} [Fri Jul 15 15:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:13.806561 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba715ee-e52f-46ff-bd96-dac276899cf2 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:13.806992 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba715ee-e52f-46ff-bd96-dac276899cf2 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:13.807161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba715ee-e52f-46ff-bd96-dac276899cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:13.826561 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6ba715ee-e52f-46ff-bd96-dac276899cf2 None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:13.832814 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6ba715ee-e52f-46ff-bd96-dac276899cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:13.841431 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 516/1028] 10.222.0.94 () {58 vars in 1015 bytes} [Fri Jul 15 15:36:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:13.855806 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3bc0d-a3b0-40eb-97bf-31050f40f2d2 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:13.856100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3bc0d-a3b0-40eb-97bf-31050f40f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:13.856380 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3bc0d-a3b0-40eb-97bf-31050f40f2d2 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:13.857896 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 513/1029] 10.222.0.94 () {54 vars in 918 bytes} [Fri Jul 15 15:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:13.862634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334960f8-d4c0-4c3a-9a15-f8bba254917c None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:13.862930 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334960f8-d4c0-4c3a-9a15-f8bba254917c None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:13.863215 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334960f8-d4c0-4c3a-9a15-f8bba254917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:13.882488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-334960f8-d4c0-4c3a-9a15-f8bba254917c None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:13.883713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-334960f8-d4c0-4c3a-9a15-f8bba254917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:13.892589 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 517/1030] 10.222.0.94 () {58 vars in 1015 bytes} [Fri Jul 15 15:36:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:16.602526 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041fd4-b6c5-4c52-868e-af17a294771d None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:16.603044 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041fd4-b6c5-4c52-868e-af17a294771d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:16.603146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041fd4-b6c5-4c52-868e-af17a294771d None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:16.604494 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 514/1031] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:16.609834 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298988f-149e-463f-a483-1520faf6d962 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:16.610248 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298988f-149e-463f-a483-1520faf6d962 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:16.610393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298988f-149e-463f-a483-1520faf6d962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:16.628957 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-5298988f-149e-463f-a483-1520faf6d962 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:16.630678 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-5298988f-149e-463f-a483-1520faf6d962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:16.638573 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 518/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:16.682487 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041fd4-b6c5-4c52-868e-af17a294771d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:16.696990 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041fd4-b6c5-4c52-868e-af17a294771d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:16.701898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60cb73-10d0-40fd-91bc-e8d7ca2a28f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:16.702531 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cb73-10d0-40fd-91bc-e8d7ca2a28f9 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:16.702812 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cb73-10d0-40fd-91bc-e8d7ca2a28f9 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:16.703091 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cb73-10d0-40fd-91bc-e8d7ca2a28f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:16.711265 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60cb73-10d0-40fd-91bc-e8d7ca2a28f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:16.712874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60cb73-10d0-40fd-91bc-e8d7ca2a28f9 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:16.722120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 515/1033] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:17.684745 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733327c-98a2-4881-b0a0-078cd1bd1f97 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:17.685280 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733327c-98a2-4881-b0a0-078cd1bd1f97 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:17.685280 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733327c-98a2-4881-b0a0-078cd1bd1f97 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:17.686662 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 519/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:17.691571 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855668-4ea0-4e81-adee-1cefdf89e80d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:17.692009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855668-4ea0-4e81-adee-1cefdf89e80d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:17.692186 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855668-4ea0-4e81-adee-1cefdf89e80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:17.710491 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7e855668-4ea0-4e81-adee-1cefdf89e80d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:17.711697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7e855668-4ea0-4e81-adee-1cefdf89e80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:17.719613 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 516/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:17.957831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733327c-98a2-4881-b0a0-078cd1bd1f97 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:17.971182 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733327c-98a2-4881-b0a0-078cd1bd1f97 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:17.977098 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5c5f3-fa30-451a-b66a-251308354210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:17.977763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5c5f3-fa30-451a-b66a-251308354210 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:17.978049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5c5f3-fa30-451a-b66a-251308354210 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:17.978328 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5c5f3-fa30-451a-b66a-251308354210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:17.987064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5c5f3-fa30-451a-b66a-251308354210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:17.988688 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5c5f3-fa30-451a-b66a-251308354210 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:17.998942 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 520/1036] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:18.890782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74988d9-012a-4e91-b4a7-a8337c036749 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:18.891319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74988d9-012a-4e91-b4a7-a8337c036749 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:18.891319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74988d9-012a-4e91-b4a7-a8337c036749 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:18.892736 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 517/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:18.897841 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671556f3-8e7c-4509-9bf9-3482e7335ff0 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:18.898292 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671556f3-8e7c-4509-9bf9-3482e7335ff0 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:18.898444 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671556f3-8e7c-4509-9bf9-3482e7335ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:18.916165 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-671556f3-8e7c-4509-9bf9-3482e7335ff0 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:18.917352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-671556f3-8e7c-4509-9bf9-3482e7335ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:18.925465 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 521/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:19.083386 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74988d9-012a-4e91-b4a7-a8337c036749 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:19.096751 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74988d9-012a-4e91-b4a7-a8337c036749 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:19.101740 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f259541-9dd5-4a68-bda8-a75b88208d06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:19.102400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259541-9dd5-4a68-bda8-a75b88208d06 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:19.102687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259541-9dd5-4a68-bda8-a75b88208d06 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:19.102968 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259541-9dd5-4a68-bda8-a75b88208d06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:19.111235 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f259541-9dd5-4a68-bda8-a75b88208d06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:19.112876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f259541-9dd5-4a68-bda8-a75b88208d06 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:19.122947 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 518/1039] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:19.988461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fbe2b-faed-4cb9-a5e3-9d8f0ca39f44 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:19.988865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fbe2b-faed-4cb9-a5e3-9d8f0ca39f44 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:19.989025 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fbe2b-faed-4cb9-a5e3-9d8f0ca39f44 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:19.990497 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 522/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:19.995275 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949ad5-f83c-4551-9e98-99937b06b0d3 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:19.995812 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949ad5-f83c-4551-9e98-99937b06b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:19.996009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949ad5-f83c-4551-9e98-99937b06b0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:20.015098 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-a5949ad5-f83c-4551-9e98-99937b06b0d3 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:20.016337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-a5949ad5-f83c-4551-9e98-99937b06b0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:20.024962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 519/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:20.177890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fbe2b-faed-4cb9-a5e3-9d8f0ca39f44 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:20.191195 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fbe2b-faed-4cb9-a5e3-9d8f0ca39f44 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:20.196706 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a8e89-53a1-4169-a832-91ffe0cdfdeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:20.197338 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8e89-53a1-4169-a832-91ffe0cdfdeb service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:20.197627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8e89-53a1-4169-a832-91ffe0cdfdeb service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:20.197941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a8e89-53a1-4169-a832-91ffe0cdfdeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:20.206113 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8e89-53a1-4169-a832-91ffe0cdfdeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:20.207692 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a8e89-53a1-4169-a832-91ffe0cdfdeb service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:20.217700 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 523/1042] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:21.080681 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da98f-24ac-41d3-ae73-5a484d37516c None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:21.081234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da98f-24ac-41d3-ae73-5a484d37516c None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:21.081234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0da98f-24ac-41d3-ae73-5a484d37516c None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:21.082764 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 520/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:21.088206 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46693be7-81e9-47cd-b8df-37ae39eb4e97 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:21.088644 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46693be7-81e9-47cd-b8df-37ae39eb4e97 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:21.088772 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46693be7-81e9-47cd-b8df-37ae39eb4e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:21.106962 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-46693be7-81e9-47cd-b8df-37ae39eb4e97 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:21.108320 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-46693be7-81e9-47cd-b8df-37ae39eb4e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:21.116111 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 524/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:21.271879 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0da98f-24ac-41d3-ae73-5a484d37516c None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:21.285423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0da98f-24ac-41d3-ae73-5a484d37516c None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:21.291700 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa71d3-686d-4ee7-92e2-2f338dd489bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:21.292538 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa71d3-686d-4ee7-92e2-2f338dd489bf service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:21.292829 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa71d3-686d-4ee7-92e2-2f338dd489bf service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:21.293109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa71d3-686d-4ee7-92e2-2f338dd489bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:21.301448 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa71d3-686d-4ee7-92e2-2f338dd489bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:21.303095 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa71d3-686d-4ee7-92e2-2f338dd489bf service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:21.314151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 521/1045] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:36:22.128701 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351726-2e18-42e3-abaa-669be96094c8 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:22.129247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351726-2e18-42e3-abaa-669be96094c8 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:22.129247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351726-2e18-42e3-abaa-669be96094c8 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:22.131174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 525/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:22.136395 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8b6e-1675-430f-a5f2-339f8899d534 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:22.136944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8b6e-1675-430f-a5f2-339f8899d534 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:22.136944 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8b6e-1675-430f-a5f2-339f8899d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:22.155183 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-a43f8b6e-1675-430f-a5f2-339f8899d534 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:22.156423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-a43f8b6e-1675-430f-a5f2-339f8899d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:22.164426 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 522/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:22.322195 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8351726-2e18-42e3-abaa-669be96094c8 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:22.335992 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8351726-2e18-42e3-abaa-669be96094c8 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:22.340835 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37122a0b-b90f-44ba-912f-3bce37681b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:22.341467 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37122a0b-b90f-44ba-912f-3bce37681b2a service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:22.341746 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37122a0b-b90f-44ba-912f-3bce37681b2a service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:22.342017 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37122a0b-b90f-44ba-912f-3bce37681b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:22.350427 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37122a0b-b90f-44ba-912f-3bce37681b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:22.352018 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37122a0b-b90f-44ba-912f-3bce37681b2a service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:22.361323 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 526/1048] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:23.180568 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebc0-aee7-4a42-8e93-c71a9a60c7e9 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:23.181019 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebc0-aee7-4a42-8e93-c71a9a60c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:23.181112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebc0-aee7-4a42-8e93-c71a9a60c7e9 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:23.182500 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 523/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:23.187374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe07e2-1a1f-4727-a65e-55616ac7a524 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:23.187848 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe07e2-1a1f-4727-a65e-55616ac7a524 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:23.187999 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe07e2-1a1f-4727-a65e-55616ac7a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:23.205804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-1bfe07e2-1a1f-4727-a65e-55616ac7a524 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:23.207007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-1bfe07e2-1a1f-4727-a65e-55616ac7a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:23.214858 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 527/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:23.372480 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaebc0-aee7-4a42-8e93-c71a9a60c7e9 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:23.386322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaebc0-aee7-4a42-8e93-c71a9a60c7e9 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:23.391198 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f61716-b6b6-4004-8a9e-7c28e7610e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:23.391861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61716-b6b6-4004-8a9e-7c28e7610e5b service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:23.392143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61716-b6b6-4004-8a9e-7c28e7610e5b service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:23.392418 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61716-b6b6-4004-8a9e-7c28e7610e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:23.400899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f61716-b6b6-4004-8a9e-7c28e7610e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:23.402525 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f61716-b6b6-4004-8a9e-7c28e7610e5b service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:23.411687 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 524/1051] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:24.218631 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d298-b4fc-42d4-b990-09369f723193 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:24.219152 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d298-b4fc-42d4-b990-09369f723193 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:24.219152 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7d298-b4fc-42d4-b990-09369f723193 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:24.220580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 528/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:24.225807 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223d7d-b589-48d7-9b07-4d796ffc2cc4 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:24.226226 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223d7d-b589-48d7-9b07-4d796ffc2cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:24.226368 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223d7d-b589-48d7-9b07-4d796ffc2cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:24.244644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-24223d7d-b589-48d7-9b07-4d796ffc2cc4 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:24.245872 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-24223d7d-b589-48d7-9b07-4d796ffc2cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:24.253679 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 525/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:24.410290 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d298-b4fc-42d4-b990-09369f723193 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:24.424139 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7d298-b4fc-42d4-b990-09369f723193 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:24.429609 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc209004-3f2b-4bd0-9d96-681bfc614bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:24.430246 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209004-3f2b-4bd0-9d96-681bfc614bf0 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:24.430530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209004-3f2b-4bd0-9d96-681bfc614bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:24.430807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209004-3f2b-4bd0-9d96-681bfc614bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:24.438730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc209004-3f2b-4bd0-9d96-681bfc614bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:24.440344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc209004-3f2b-4bd0-9d96-681bfc614bf0 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:24.449587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 529/1054] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:25.258056 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7e9f9-d6ff-45c7-ab34-eb7e2b996f6f None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:25.258604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7e9f9-d6ff-45c7-ab34-eb7e2b996f6f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:25.258604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7e9f9-d6ff-45c7-ab34-eb7e2b996f6f None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:25.260007 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 526/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:25.264995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1a4e-e32d-4979-801c-bbd5b5a8a062 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:25.265399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1a4e-e32d-4979-801c-bbd5b5a8a062 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:25.265564 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1a4e-e32d-4979-801c-bbd5b5a8a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:25.283691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-b81c1a4e-e32d-4979-801c-bbd5b5a8a062 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:25.284922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-b81c1a4e-e32d-4979-801c-bbd5b5a8a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:25.293160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 530/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:36:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:25.447423 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7e9f9-d6ff-45c7-ab34-eb7e2b996f6f None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:25.461518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7e9f9-d6ff-45c7-ab34-eb7e2b996f6f None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:25.466820 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd063dd-d672-4577-94f9-35f51747c76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:25.467452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd063dd-d672-4577-94f9-35f51747c76d service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:25.467767 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd063dd-d672-4577-94f9-35f51747c76d service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:25.468056 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd063dd-d672-4577-94f9-35f51747c76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:25.476164 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd063dd-d672-4577-94f9-35f51747c76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:25.477745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd063dd-d672-4577-94f9-35f51747c76d service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:25.487145 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 527/1057] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:27.574163 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f881-4916-4eb0-9b70-b5435cea3df6 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:27.574853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f881-4916-4eb0-9b70-b5435cea3df6 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:27.574853 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26f881-4916-4eb0-9b70-b5435cea3df6 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:27.576216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 531/1058] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:27.581780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41c978-cb9a-48dd-95b9-0e286a9995c7 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:27.582169 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41c978-cb9a-48dd-95b9-0e286a9995c7 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:27.582344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41c978-cb9a-48dd-95b9-0e286a9995c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:27.600532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8f41c978-cb9a-48dd-95b9-0e286a9995c7 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:27.601732 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8f41c978-cb9a-48dd-95b9-0e286a9995c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:27.609636 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 528/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:27.649670 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26f881-4916-4eb0-9b70-b5435cea3df6 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:27.660318 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26f881-4916-4eb0-9b70-b5435cea3df6 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:27.664512 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31060507-aab9-41b8-a46b-0ff5a7d05cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:27.665180 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060507-aab9-41b8-a46b-0ff5a7d05cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:27.665469 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060507-aab9-41b8-a46b-0ff5a7d05cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:27.665769 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060507-aab9-41b8-a46b-0ff5a7d05cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:27.675496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31060507-aab9-41b8-a46b-0ff5a7d05cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:27.676963 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31060507-aab9-41b8-a46b-0ff5a7d05cb2 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:27.687095 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 532/1060] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:30.056412 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7186e-3cb4-407b-b6c3-eca277f56f80 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:30.056967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7186e-3cb4-407b-b6c3-eca277f56f80 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:30.056967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7186e-3cb4-407b-b6c3-eca277f56f80 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:30.058399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 529/1061] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:30.063844 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4ae8-970a-46ad-8c11-53d55eefaea2 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:30.064279 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4ae8-970a-46ad-8c11-53d55eefaea2 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:30.064418 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4ae8-970a-46ad-8c11-53d55eefaea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:30.081777 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-9a2d4ae8-970a-46ad-8c11-53d55eefaea2 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:30.082977 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-9a2d4ae8-970a-46ad-8c11-53d55eefaea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:30.091300 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 533/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:30.131299 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7186e-3cb4-407b-b6c3-eca277f56f80 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:30.142543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7186e-3cb4-407b-b6c3-eca277f56f80 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:30.146100 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db54db-5343-4dd2-a2c1-c0ef4b67d643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:30.147341 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db54db-5343-4dd2-a2c1-c0ef4b67d643 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:30.147726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db54db-5343-4dd2-a2c1-c0ef4b67d643 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:30.148028 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db54db-5343-4dd2-a2c1-c0ef4b67d643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:30.156934 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db54db-5343-4dd2-a2c1-c0ef4b67d643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:30.158361 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db54db-5343-4dd2-a2c1-c0ef4b67d643 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:30.168668 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 530/1063] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:32.753529 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe47fb-9c9d-4708-a974-d534af08ef95 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:32.754064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe47fb-9c9d-4708-a974-d534af08ef95 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:32.754064 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe47fb-9c9d-4708-a974-d534af08ef95 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:32.755443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 534/1064] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:32.761069 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf369a-a4de-4e39-ad2e-46a49eca6ba0 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:32.761548 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf369a-a4de-4e39-ad2e-46a49eca6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:32.761645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf369a-a4de-4e39-ad2e-46a49eca6ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:32.778991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-5ccf369a-a4de-4e39-ad2e-46a49eca6ba0 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:32.780204 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-5ccf369a-a4de-4e39-ad2e-46a49eca6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:32.788467 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 531/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:32.829548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe47fb-9c9d-4708-a974-d534af08ef95 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:32.841235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe47fb-9c9d-4708-a974-d534af08ef95 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:32.844812 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a7ea8-0bef-4035-9c30-fb2df3efb57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:32.845453 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a7ea8-0bef-4035-9c30-fb2df3efb57c service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:32.845740 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a7ea8-0bef-4035-9c30-fb2df3efb57c service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:32.846020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a7ea8-0bef-4035-9c30-fb2df3efb57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:32.855667 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a7ea8-0bef-4035-9c30-fb2df3efb57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:32.857252 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a7ea8-0bef-4035-9c30-fb2df3efb57c service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:32.867299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 535/1066] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:35.237775 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e607-4c55-4b05-aae3-4bdafe37c542 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:35.238583 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e607-4c55-4b05-aae3-4bdafe37c542 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:35.238583 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e607-4c55-4b05-aae3-4bdafe37c542 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:35.239697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 532/1067] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:36:35.244980 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8805-94cf-440d-91b0-6eca571c985a None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:35.245430 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8805-94cf-440d-91b0-6eca571c985a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:35.245549 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8805-94cf-440d-91b0-6eca571c985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:35.263727 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-7aba8805-94cf-440d-91b0-6eca571c985a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:35.264940 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-7aba8805-94cf-440d-91b0-6eca571c985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:35.273347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 536/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:35.312285 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2e607-4c55-4b05-aae3-4bdafe37c542 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:35.323332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2e607-4c55-4b05-aae3-4bdafe37c542 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:35.327017 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517873b2-6ced-4482-bb8d-cf380e8eb8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:35.327653 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517873b2-6ced-4482-bb8d-cf380e8eb8fa service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:35.328016 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517873b2-6ced-4482-bb8d-cf380e8eb8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:35.328273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517873b2-6ced-4482-bb8d-cf380e8eb8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:35.337239 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517873b2-6ced-4482-bb8d-cf380e8eb8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:35.338711 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517873b2-6ced-4482-bb8d-cf380e8eb8fa service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:35.348276 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 533/1069] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:37.610363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449828bb-8eee-4b67-a5a6-fb90922d1fb6 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:37.610942 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449828bb-8eee-4b67-a5a6-fb90922d1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:37.610942 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449828bb-8eee-4b67-a5a6-fb90922d1fb6 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:37.612300 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 537/1070] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:37.617528 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82647e3d-3963-4648-9706-15df972d8676 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:37.617945 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82647e3d-3963-4648-9706-15df972d8676 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:37.618093 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82647e3d-3963-4648-9706-15df972d8676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:37.635922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-82647e3d-3963-4648-9706-15df972d8676 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:37.637134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-82647e3d-3963-4648-9706-15df972d8676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:37.644837 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 534/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:37.685540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449828bb-8eee-4b67-a5a6-fb90922d1fb6 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:37.696286 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449828bb-8eee-4b67-a5a6-fb90922d1fb6 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:37.699831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16fac6-2172-4297-bd81-a7b1fe867370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:37.700468 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16fac6-2172-4297-bd81-a7b1fe867370 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:37.700756 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16fac6-2172-4297-bd81-a7b1fe867370 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:37.701036 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16fac6-2172-4297-bd81-a7b1fe867370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:37.710681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16fac6-2172-4297-bd81-a7b1fe867370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:37.712196 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16fac6-2172-4297-bd81-a7b1fe867370 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:37.721761 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 538/1072] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:39.977669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05eea4-0556-4407-a79c-1dbc9b11c783 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:39.978115 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05eea4-0556-4407-a79c-1dbc9b11c783 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:39.978207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05eea4-0556-4407-a79c-1dbc9b11c783 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:39.979589 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 535/1073] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:39.985150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0346f-4133-448c-8e16-d3e1bd401c04 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:39.985572 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0346f-4133-448c-8e16-d3e1bd401c04 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:39.985747 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0346f-4133-448c-8e16-d3e1bd401c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:40.003157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-4ee0346f-4133-448c-8e16-d3e1bd401c04 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:40.004429 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-4ee0346f-4133-448c-8e16-d3e1bd401c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:40.012623 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 539/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:40.052850 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05eea4-0556-4407-a79c-1dbc9b11c783 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:40.063444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05eea4-0556-4407-a79c-1dbc9b11c783 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:40.066868 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c625d-4998-4475-8ec4-e14703f8af96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:40.067525 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c625d-4998-4475-8ec4-e14703f8af96 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:40.067840 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c625d-4998-4475-8ec4-e14703f8af96 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:40.068119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c625d-4998-4475-8ec4-e14703f8af96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:40.076899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c625d-4998-4475-8ec4-e14703f8af96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:40.078322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c625d-4998-4475-8ec4-e14703f8af96 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:40.088027 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 536/1075] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:42.412351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f52f-277d-4619-91d1-38477d22813b None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:42.413464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f52f-277d-4619-91d1-38477d22813b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:42.413464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f52f-277d-4619-91d1-38477d22813b None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:42.414815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 540/1076] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:42.420236 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854743d5-a05e-41cc-a0f6-c7c01e86daf9 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:42.420644 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854743d5-a05e-41cc-a0f6-c7c01e86daf9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:42.420798 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854743d5-a05e-41cc-a0f6-c7c01e86daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:42.426821 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=70 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:42.440155 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-854743d5-a05e-41cc-a0f6-c7c01e86daf9 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:42.441358 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-854743d5-a05e-41cc-a0f6-c7c01e86daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:42.449143 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 537/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:36:42.487648 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f52f-277d-4619-91d1-38477d22813b None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:42.493727 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=73 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:42.500111 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f52f-277d-4619-91d1-38477d22813b None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:42.503598 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a272c-2a19-4bfc-bc7d-9cdbcab52d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:42.504266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a272c-2a19-4bfc-bc7d-9cdbcab52d9a service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:42.504557 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a272c-2a19-4bfc-bc7d-9cdbcab52d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:42.504839 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a272c-2a19-4bfc-bc7d-9cdbcab52d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:42.514371 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a272c-2a19-4bfc-bc7d-9cdbcab52d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:42.515837 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a272c-2a19-4bfc-bc7d-9cdbcab52d9a service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:42.525240 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 541/1078] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:44.770982 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b24e3-09e6-40af-b323-af5b2df98733 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:44.771634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b24e3-09e6-40af-b323-af5b2df98733 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:44.771634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b24e3-09e6-40af-b323-af5b2df98733 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:44.773634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 538/1079] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:44.778912 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8dde-6659-444c-87be-d6761b8d64e4 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:44.779361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8dde-6659-444c-87be-d6761b8d64e4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:44.779461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8dde-6659-444c-87be-d6761b8d64e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:44.796893 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-041a8dde-6659-444c-87be-d6761b8d64e4 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:44.798094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-041a8dde-6659-444c-87be-d6761b8d64e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:44.806055 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 542/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:44.845755 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b24e3-09e6-40af-b323-af5b2df98733 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:44.856859 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b24e3-09e6-40af-b323-af5b2df98733 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:44.860477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb870b-b901-492a-ab7a-a859acaea7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:44.861113 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb870b-b901-492a-ab7a-a859acaea7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:44.861401 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb870b-b901-492a-ab7a-a859acaea7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:44.861682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb870b-b901-492a-ab7a-a859acaea7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:44.870641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb870b-b901-492a-ab7a-a859acaea7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:44.872194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb870b-b901-492a-ab7a-a859acaea7e7 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:44.882363 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 539/1081] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:47.094258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e870-09c3-4cdb-adc0-69fdd5898d4c None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:47.094816 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e870-09c3-4cdb-adc0-69fdd5898d4c None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:47.094816 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21e870-09c3-4cdb-adc0-69fdd5898d4c None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:47.096335 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 543/1082] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:47.102120 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fdeaa-157d-4ab7-b8ae-5b1e89aa3c57 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:47.102520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fdeaa-157d-4ab7-b8ae-5b1e89aa3c57 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:47.102673 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fdeaa-157d-4ab7-b8ae-5b1e89aa3c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:47.121156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-6e6fdeaa-157d-4ab7-b8ae-5b1e89aa3c57 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:47.122332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-6e6fdeaa-157d-4ab7-b8ae-5b1e89aa3c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:47.129946 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 540/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:47.167216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21e870-09c3-4cdb-adc0-69fdd5898d4c None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:47.178036 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21e870-09c3-4cdb-adc0-69fdd5898d4c None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:47.182141 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a0b1-049e-4536-98dd-1b72fa1de5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:47.182774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a0b1-049e-4536-98dd-1b72fa1de5be service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:47.183059 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a0b1-049e-4536-98dd-1b72fa1de5be service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:47.183338 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a0b1-049e-4536-98dd-1b72fa1de5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:47.192365 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226a0b1-049e-4536-98dd-1b72fa1de5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:47.193789 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226a0b1-049e-4536-98dd-1b72fa1de5be service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:47.203171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 544/1084] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:49.454780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eb15-4939-40bb-8339-399d7ed8b888 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:49.455361 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eb15-4939-40bb-8339-399d7ed8b888 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:49.455361 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291eb15-4939-40bb-8339-399d7ed8b888 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:49.456833 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 541/1085] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:36:49.462324 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c865aef-22e2-4b26-9f3e-ed6058b1fb40 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:49.462748 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c865aef-22e2-4b26-9f3e-ed6058b1fb40 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:49.462893 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c865aef-22e2-4b26-9f3e-ed6058b1fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:49.480877 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-4c865aef-22e2-4b26-9f3e-ed6058b1fb40 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:36:49.482144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-4c865aef-22e2-4b26-9f3e-ed6058b1fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:36:49.489922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 545/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:36:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:36:49.527264 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291eb15-4939-40bb-8339-399d7ed8b888 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:36:49.537916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291eb15-4939-40bb-8339-399d7ed8b888 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:36:49.541950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ebc5a-6eb4-48f9-a4af-3db023b38420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:36:49.542581 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ebc5a-6eb4-48f9-a4af-3db023b38420 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:36:49.542868 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ebc5a-6eb4-48f9-a4af-3db023b38420 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:36:49.543146 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ebc5a-6eb4-48f9-a4af-3db023b38420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:36:49.552157 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ebc5a-6eb4-48f9-a4af-3db023b38420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:36:49.553590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ebc5a-6eb4-48f9-a4af-3db023b38420 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:36:49.563138 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 542/1087] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:36:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:36:59.475189 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=17 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:36:59.558883 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=17 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:13.062846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df59c09-b91c-4189-9161-4c5fcbf493ae None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:13.063392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df59c09-b91c-4189-9161-4c5fcbf493ae None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:13.063498 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df59c09-b91c-4189-9161-4c5fcbf493ae None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:13.064872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 546/1088] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:13.070097 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34994-e8cd-4729-8a30-44b460c84a6c None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:13.070520 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34994-e8cd-4729-8a30-44b460c84a6c None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:13.070660 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34994-e8cd-4729-8a30-44b460c84a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:13.088905 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-4da34994-e8cd-4729-8a30-44b460c84a6c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:13.090028 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-4da34994-e8cd-4729-8a30-44b460c84a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:13.097798 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 543/1089] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:37:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:13.147860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a60f9-658b-4109-a52f-1eb2326cfe32 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:13.148150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a60f9-658b-4109-a52f-1eb2326cfe32 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:13.148433 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a60f9-658b-4109-a52f-1eb2326cfe32 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:13.150353 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 547/1090] 10.222.0.94 () {54 vars in 960 bytes} [Fri Jul 15 15:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:13.155957 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902812-42b8-4e95-9be5-5f385671abcb None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:13.156278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902812-42b8-4e95-9be5-5f385671abcb None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:13.156563 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902812-42b8-4e95-9be5-5f385671abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:13.175417 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f7902812-42b8-4e95-9be5-5f385671abcb None None] MFA Rules not processed for user `4c96f27d72744e5fb22cbe798a0cb98e`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:13.176663 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f7902812-42b8-4e95-9be5-5f385671abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:13.183248 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 544/1091] 10.222.0.94 () {58 vars in 1057 bytes} [Fri Jul 15 15:37:13 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:13.190802 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a60f9-658b-4109-a52f-1eb2326cfe32 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:13.201941 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a60f9-658b-4109-a52f-1eb2326cfe32 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:13.205525 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b52cf6-df89-49af-b9fb-bd835d2693f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c96f27d72744e5fb22cbe798a0cb98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:13.206161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b52cf6-df89-49af-b9fb-bd835d2693f0 service glance] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:13.206450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b52cf6-df89-49af-b9fb-bd835d2693f0 service glance] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:13.206729 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b52cf6-df89-49af-b9fb-bd835d2693f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:13.216350 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b52cf6-df89-49af-b9fb-bd835d2693f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:13.217778 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b52cf6-df89-49af-b9fb-bd835d2693f0 service glance] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:13.227346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 548/1092] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:37:15.518213 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d7a7-26bb-43e6-8748-f3d0634831a1 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:15.518861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d7a7-26bb-43e6-8748-f3d0634831a1 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:15.518861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d7a7-26bb-43e6-8748-f3d0634831a1 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:15.520179 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 545/1093] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:15.525943 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948cdc7-d6df-473a-88a9-0e73695af123 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:15.526371 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948cdc7-d6df-473a-88a9-0e73695af123 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:15.526517 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948cdc7-d6df-473a-88a9-0e73695af123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:15.544214 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-e948cdc7-d6df-473a-88a9-0e73695af123 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:15.545420 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-e948cdc7-d6df-473a-88a9-0e73695af123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:15.553383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 549/1094] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:37:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:15.577030 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078d7a7-26bb-43e6-8748-f3d0634831a1 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:15.590294 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078d7a7-26bb-43e6-8748-f3d0634831a1 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:15.594781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b73b6-0417-49fe-b3c3-0fb66a065cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:15.595420 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b73b6-0417-49fe-b3c3-0fb66a065cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:15.595707 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b73b6-0417-49fe-b3c3-0fb66a065cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:15.596017 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b73b6-0417-49fe-b3c3-0fb66a065cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:15.596740 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b73b6-0417-49fe-b3c3-0fb66a065cb6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:15.598495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-5f3b73b6-0417-49fe-b3c3-0fb66a065cb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:37:15.598495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:37:15.598495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:37:15.599648 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b73b6-0417-49fe-b3c3-0fb66a065cb6 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:15.617798 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 546/1095] 10.222.0.94 () {56 vars in 1108 bytes} [Fri Jul 15 15:37:15 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:37:17.874317 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8c66-8047-49e8-ae73-2619687e7a0e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:17.874885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8c66-8047-49e8-ae73-2619687e7a0e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:17.874885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8c66-8047-49e8-ae73-2619687e7a0e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:17.876344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 550/1096] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:17.881438 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315832-9218-4033-bb04-873c994b2c0a None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:17.881873 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315832-9218-4033-bb04-873c994b2c0a None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:17.882008 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7315832-9218-4033-bb04-873c994b2c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:17.902009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f7315832-9218-4033-bb04-873c994b2c0a None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:17.903378 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f7315832-9218-4033-bb04-873c994b2c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:17.911140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 547/1097] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:37:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:17.955101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb8c66-8047-49e8-ae73-2619687e7a0e None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:17.969787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb8c66-8047-49e8-ae73-2619687e7a0e None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:17.974796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c2722-34ab-42f8-bcc7-5e102bf2125a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:17.975444 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2722-34ab-42f8-bcc7-5e102bf2125a service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:17.976166 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2722-34ab-42f8-bcc7-5e102bf2125a service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:17.976456 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2722-34ab-42f8-bcc7-5e102bf2125a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:17.986645 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c2722-34ab-42f8-bcc7-5e102bf2125a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:17.988663 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c2722-34ab-42f8-bcc7-5e102bf2125a service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:17.998113 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 551/1098] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:20.377894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8537c1-dd39-4d10-a05b-d0fa4fed5853 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:20.378469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8537c1-dd39-4d10-a05b-d0fa4fed5853 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:20.378469 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8537c1-dd39-4d10-a05b-d0fa4fed5853 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:20.379897 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 548/1099] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:20.385155 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9e6e-2c1d-4ce5-8db5-9b599bb6d2f4 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:20.385572 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9e6e-2c1d-4ce5-8db5-9b599bb6d2f4 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:20.385717 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9e6e-2c1d-4ce5-8db5-9b599bb6d2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:20.403624 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-4fbe9e6e-2c1d-4ce5-8db5-9b599bb6d2f4 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:20.404821 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-4fbe9e6e-2c1d-4ce5-8db5-9b599bb6d2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:20.413176 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 552/1100] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:37:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:20.451292 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8537c1-dd39-4d10-a05b-d0fa4fed5853 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:20.462951 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8537c1-dd39-4d10-a05b-d0fa4fed5853 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:20.466443 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d522a-262c-401f-8284-0cdb295dde11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:20.467079 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d522a-262c-401f-8284-0cdb295dde11 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:20.467450 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d522a-262c-401f-8284-0cdb295dde11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:20.467871 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d522a-262c-401f-8284-0cdb295dde11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:20.476684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d522a-262c-401f-8284-0cdb295dde11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:20.478782 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d522a-262c-401f-8284-0cdb295dde11 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:20.488672 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 549/1101] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:22.777459 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f321d0-2762-4721-a067-cd644cdb8132 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.778019 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f321d0-2762-4721-a067-cd644cdb8132 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.778019 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f321d0-2762-4721-a067-cd644cdb8132 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.779363 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 553/1102] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:22.784726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593788-777d-45bf-9b94-cf8b889c6e30 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.785163 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593788-777d-45bf-9b94-cf8b889c6e30 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.785351 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593788-777d-45bf-9b94-cf8b889c6e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.803721 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-f8593788-777d-45bf-9b94-cf8b889c6e30 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:22.804945 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-f8593788-777d-45bf-9b94-cf8b889c6e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:22.812845 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 550/1103] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:37:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:22.854879 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f321d0-2762-4721-a067-cd644cdb8132 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:22.865458 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f321d0-2762-4721-a067-cd644cdb8132 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:22.869345 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130be95-acf8-4c64-99e9-2aacf77d2065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:22.869979 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130be95-acf8-4c64-99e9-2aacf77d2065 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:22.870272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130be95-acf8-4c64-99e9-2aacf77d2065 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:22.870559 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130be95-acf8-4c64-99e9-2aacf77d2065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:22.879389 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130be95-acf8-4c64-99e9-2aacf77d2065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:22.880869 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130be95-acf8-4c64-99e9-2aacf77d2065 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:22.890898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 554/1104] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:25.279248 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2b64a-7ed2-430e-ad05-13872c74ac6f None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:25.279819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2b64a-7ed2-430e-ad05-13872c74ac6f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:25.279819 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2b64a-7ed2-430e-ad05-13872c74ac6f None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:25.281208 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 551/1105] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:25.286321 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a8fd6-3449-4fed-8f0f-fab7832dc35c None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:25.286762 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a8fd6-3449-4fed-8f0f-fab7832dc35c None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:25.286869 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a8fd6-3449-4fed-8f0f-fab7832dc35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:25.305978 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-e67a8fd6-3449-4fed-8f0f-fab7832dc35c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:25.307175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-e67a8fd6-3449-4fed-8f0f-fab7832dc35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:25.314885 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 555/1106] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:37:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:37:25.357518 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2b64a-7ed2-430e-ad05-13872c74ac6f None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:25.368838 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2b64a-7ed2-430e-ad05-13872c74ac6f None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:25.372320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa028770-9a7a-4654-8233-02fadd706305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:25.372958 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028770-9a7a-4654-8233-02fadd706305 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:25.373252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028770-9a7a-4654-8233-02fadd706305 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:25.373535 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa028770-9a7a-4654-8233-02fadd706305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:25.382402 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028770-9a7a-4654-8233-02fadd706305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:25.383876 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa028770-9a7a-4654-8233-02fadd706305 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:25.393777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 552/1107] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:27.838917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1206-9cb7-4821-85bf-bccb13241abc None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:27.839450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1206-9cb7-4821-85bf-bccb13241abc None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:27.839450 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1206-9cb7-4821-85bf-bccb13241abc None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:27.840873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 556/1108] 10.222.0.94 () {54 vars in 926 bytes} [Fri Jul 15 15:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:37:27.846127 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49367-fd18-4110-bf84-7d985e57bc9f None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:27.846554 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49367-fd18-4110-bf84-7d985e57bc9f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:27.846715 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49367-fd18-4110-bf84-7d985e57bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:27.864784 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-d2e49367-fd18-4110-bf84-7d985e57bc9f None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:37:27.865967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-d2e49367-fd18-4110-bf84-7d985e57bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:37:27.873648 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 553/1109] 10.222.0.94 () {58 vars in 1023 bytes} [Fri Jul 15 15:37:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:37:27.913393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1206-9cb7-4821-85bf-bccb13241abc None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:37:27.924503 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1206-9cb7-4821-85bf-bccb13241abc None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:37:27.927914 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad04f4-65ff-4409-a6d1-c90266f28100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:37:27.928537 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad04f4-65ff-4409-a6d1-c90266f28100 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:37:27.928819 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad04f4-65ff-4409-a6d1-c90266f28100 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:37:27.929090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad04f4-65ff-4409-a6d1-c90266f28100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:37:27.937651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad04f4-65ff-4409-a6d1-c90266f28100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:37:27.939063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad04f4-65ff-4409-a6d1-c90266f28100 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:37:27.948541 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 557/1110] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:37:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:37:37.859713 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=33 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:37:37.944238 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=33 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:38:59.428697 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81b0f-a44e-4649-868a-e5c70c0a454d None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.429302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81b0f-a44e-4649-868a-e5c70c0a454d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.429302 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81b0f-a44e-4649-868a-e5c70c0a454d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.447162 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-0ba81b0f-a44e-4649-868a-e5c70c0a454d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:38:59.448454 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-0ba81b0f-a44e-4649-868a-e5c70c0a454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:38:59.456199 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 554/1111] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:38:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:38:59.464553 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853e166-2ee8-4691-bed0-4b89ffeaf87c None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.465051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853e166-2ee8-4691-bed0-4b89ffeaf87c None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.465146 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853e166-2ee8-4691-bed0-4b89ffeaf87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.483038 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-c853e166-2ee8-4691-bed0-4b89ffeaf87c None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:38:59.484255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-c853e166-2ee8-4691-bed0-4b89ffeaf87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:38:59.491949 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 558/1112] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:38:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:38:59.496408 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81b0f-a44e-4649-868a-e5c70c0a454d None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:38:59.506063 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81b0f-a44e-4649-868a-e5c70c0a454d None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:38:59.510813 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:38:59.511466 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.511789 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.512075 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.512792 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:38:59.513104 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:38:59.514114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:38:59.514114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:38:59.514114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:38:59.515256 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:38:59.527277 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 555/1113] 10.222.0.94 () {58 vars in 1152 bytes} [Fri Jul 15 15:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:38:59.535054 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853e166-2ee8-4691-bed0-4b89ffeaf87c None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:38:59.544641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853e166-2ee8-4691-bed0-4b89ffeaf87c None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:38:59.549208 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:38:59.549846 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.550130 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.550407 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.551094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:38:59.552822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING py.warnings [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:38:59.552822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: warnings.warn(msg) Jul 15 15:38:59.552822 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: Jul 15 15:38:59.554002 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:38:59.579985 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 559/1114] 10.222.0.94 () {60 vars in 1152 bytes} [Fri Jul 15 15:38:59 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:38:59.584194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:38:59.594550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4359f2-4218-4c4c-9216-9a349f861d60 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:38:59.649147 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:38:59.649865 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.650152 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.650436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.651124 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:38:59.652720 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:38:59.652720 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:38:59.652720 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:38:59.653929 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:38:59.674871 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 556/1115] 10.222.0.94 () {60 vars in 1143 bytes} [Fri Jul 15 15:38:59 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:38:59.679200 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:38:59.692235 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14991a-032e-40e5-b090-3ec7983cf43f admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:38:59.696895 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:38:59.697558 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.697845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.698675 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.699430 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:38:59.700945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING py.warnings [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:38:59.700945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: warnings.warn(msg) Jul 15 15:38:59.700945 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: Jul 15 15:38:59.701937 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:38:59.715684 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 560/1116] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:38:59.719554 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:38:59.729590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97131d-5d85-4150-9fee-c39ed2e652d3 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:38:59.734236 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f6c5f-a87d-4223-b969-7fa2e421d199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:38:59.734891 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6c5f-a87d-4223-b969-7fa2e421d199 admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.735180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6c5f-a87d-4223-b969-7fa2e421d199 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.735472 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6c5f-a87d-4223-b969-7fa2e421d199 admin admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.736221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f6c5f-a87d-4223-b969-7fa2e421d199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:38:59.737231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-bf2f6c5f-a87d-4223-b969-7fa2e421d199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:38:59.737231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:38:59.737231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:38:59.738129 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f6c5f-a87d-4223-b969-7fa2e421d199 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:38:59.751394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 557/1117] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:38:59.755587 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:38:59.766620 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895034-2053-4b8d-9c61-3cfe6956c898 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:38:59.771195 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11998b-eacb-4dd3-81a5-a3fa88c6b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:38:59.772244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11998b-eacb-4dd3-81a5-a3fa88c6b95c admin admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.772533 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11998b-eacb-4dd3-81a5-a3fa88c6b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.772813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11998b-eacb-4dd3-81a5-a3fa88c6b95c admin admin] PATH_INFO: `/v3/projects/fa9a432b013f4156be794dd8f06fd32c/users/f153f811bfff4ee9b8a725c4de5f004e/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.788199 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11998b-eacb-4dd3-81a5-a3fa88c6b95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9a432b013f4156be794dd8f06fd32c, user_id=f153f811bfff4ee9b8a725c4de5f004e, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:38:59.789237 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING py.warnings [None req-6c11998b-eacb-4dd3-81a5-a3fa88c6b95c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:38:59.789237 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: warnings.warn(msg) Jul 15 15:38:59.789237 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: Jul 15 15:38:59.791184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11998b-eacb-4dd3-81a5-a3fa88c6b95c admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:38:59.803699 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 561/1118] 10.222.0.94 () {60 vars in 1482 bytes} [Fri Jul 15 15:38:59 2022] PUT /identity/v3/projects/fa9a432b013f4156be794dd8f06fd32c/users/f153f811bfff4ee9b8a725c4de5f004e/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:38:59.815843 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cca7d-b119-4586-9b1f-1b81945990b6 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.816141 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cca7d-b119-4586-9b1f-1b81945990b6 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.816427 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cca7d-b119-4586-9b1f-1b81945990b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.843141 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e20cca7d-b119-4586-9b1f-1b81945990b6 None None] MFA Rules not processed for user `f153f811bfff4ee9b8a725c4de5f004e`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:38:59.844396 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e20cca7d-b119-4586-9b1f-1b81945990b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:38:59.908725 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 558/1119] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:38:59 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:38:59.921605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3646b-245a-4b0e-bb2f-7a404a284fb0 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.921895 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3646b-245a-4b0e-bb2f-7a404a284fb0 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.922203 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3646b-245a-4b0e-bb2f-7a404a284fb0 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.923547 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 562/1120] 10.222.0.94 () {54 vars in 963 bytes} [Fri Jul 15 15:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:38:59.928331 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785052c-8642-4c8e-8a42-a37416aeba73 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:38:59.928630 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785052c-8642-4c8e-8a42-a37416aeba73 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:38:59.928916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785052c-8642-4c8e-8a42-a37416aeba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:38:59.947769 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-e785052c-8642-4c8e-8a42-a37416aeba73 None None] MFA Rules not processed for user `5904a25265304dc683441c3b110bd1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:38:59.949411 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e785052c-8642-4c8e-8a42-a37416aeba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:38:59.993027 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:00.001738 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 559/1121] 10.222.0.94 () {58 vars in 1060 bytes} [Fri Jul 15 15:38:59 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:39:00.009246 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3646b-245a-4b0e-bb2f-7a404a284fb0 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:39:00.020460 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3646b-245a-4b0e-bb2f-7a404a284fb0 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:39:00.024016 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5904a25265304dc683441c3b110bd1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:39:00.024650 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:39:00.024939 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:39:00.025222 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:39:00.034144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:39:00.035575 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:39:00.044276 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 563/1122] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:39:00 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:39:00.079374 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0882f8-92a0-420e-8396-ff177b24899d None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:39:00.079669 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0882f8-92a0-420e-8396-ff177b24899d None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:39:00.079983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0882f8-92a0-420e-8396-ff177b24899d None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:39:00.081266 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 560/1123] 10.222.0.94 () {52 vars in 829 bytes} [Fri Jul 15 15:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:39:00.084777 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:39:00.146714 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4803619-0271-478f-86ce-c42fc34912d0 service cinder] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:39:00.151377 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:39:00.152271 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:39:00.152565 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:39:00.152845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] PATH_INFO: `/v3/users/f153f811bfff4ee9b8a725c4de5f004e` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:39:00.154042 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f153f811bfff4ee9b8a725c4de5f004e)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:39:00.155063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING py.warnings [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:39:00.155063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: warnings.warn(msg) Jul 15 15:39:00.155063 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: Jul 15 15:39:00.156310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:39:00.221694 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f153f811bfff4ee9b8a725c4de5f004e'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.233948 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f153f811bfff4ee9b8a725c4de5f004e'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.252496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f153f811bfff4ee9b8a725c4de5f004e'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.253284 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f153f811bfff4ee9b8a725c4de5f004e'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.263759 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f153f811bfff4ee9b8a725c4de5f004e'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.270205 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 564/1124] 10.222.0.94 () {58 vars in 1223 bytes} [Fri Jul 15 15:39:00 2022] DELETE /identity/v3/users/f153f811bfff4ee9b8a725c4de5f004e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:39:00.274816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3800-0582-4929-9349-474d447174ab None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:39:00.275193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3800-0582-4929-9349-474d447174ab None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:39:00.275553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3800-0582-4929-9349-474d447174ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:39:00.293470 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-880a3800-0582-4929-9349-474d447174ab None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:39:00.294685 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-880a3800-0582-4929-9349-474d447174ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:39:00.352688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 561/1125] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:39:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:39:00.362288 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:39:00.363698 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:39:00.369144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:00.422755 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525320-34b2-4105-922d-d5af40cdb662 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:39:00.426472 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec1e45-6549-4f16-9e73-9c0aca380b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:39:00.427115 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1e45-6549-4f16-9e73-9c0aca380b43 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:39:00.427402 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1e45-6549-4f16-9e73-9c0aca380b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:39:00.427684 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec1e45-6549-4f16-9e73-9c0aca380b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:39:00.437128 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec1e45-6549-4f16-9e73-9c0aca380b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:39:00.438642 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec1e45-6549-4f16-9e73-9c0aca380b43 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:39:00.447976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 565/1126] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:39:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:39:00.771109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a3800-0582-4929-9349-474d447174ab None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:39:00.775846 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-880a3800-0582-4929-9349-474d447174ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:39:00.784797 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a3800-0582-4929-9349-474d447174ab None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:39:00.789675 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:39:00.790481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:39:00.790772 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:39:00.791049 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] PATH_INFO: `/v3/projects/fa9a432b013f4156be794dd8f06fd32c` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:39:00.792852 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9a432b013f4156be794dd8f06fd32c)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:39:00.793922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:39:00.793922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:39:00.793922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:39:00.795071 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:39:00.857456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9a432b013f4156be794dd8f06fd32c', 'request_id': 'req-9eba3838-4c68-453f-a87b-ae85e9c3306f'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.867461 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9a432b013f4156be794dd8f06fd32c', 'request_id': 'req-9eba3838-4c68-453f-a87b-ae85e9c3306f'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.873545 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9a432b013f4156be794dd8f06fd32c', 'request_id': 'req-9eba3838-4c68-453f-a87b-ae85e9c3306f'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.891334 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] The token cache is being invalidate because project fa9a432b013f4156be794dd8f06fd32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:39:00.891621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.892286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-9eba3838-4c68-453f-a87b-ae85e9c3306f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:39:00.893932 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 562/1127] 10.222.0.94 () {58 vars in 1232 bytes} [Fri Jul 15 15:39:00 2022] DELETE /identity/v3/projects/fa9a432b013f4156be794dd8f06fd32c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:39:10.443870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=25 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:39:10.888179 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:26.822720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8792cd-bc93-47d0-9f35-503c57c1abf0 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:26.823276 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8792cd-bc93-47d0-9f35-503c57c1abf0 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:26.823276 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8792cd-bc93-47d0-9f35-503c57c1abf0 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:26.825247 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 566/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:26.830252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204749-1238-4808-b15f-9fb8ef897b78 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:26.830678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204749-1238-4808-b15f-9fb8ef897b78 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:26.830826 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe204749-1238-4808-b15f-9fb8ef897b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:26.904409 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-fe204749-1238-4808-b15f-9fb8ef897b78 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:26.905631 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-fe204749-1238-4808-b15f-9fb8ef897b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:27.007173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 563/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:40:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:27.165842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8792cd-bc93-47d0-9f35-503c57c1abf0 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:27.167548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-5e8792cd-bc93-47d0-9f35-503c57c1abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:27.256495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8792cd-bc93-47d0-9f35-503c57c1abf0 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:27.262031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49024041-faa7-4640-95c1-78564c4aa441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:27.262678 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49024041-faa7-4640-95c1-78564c4aa441 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:27.262968 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49024041-faa7-4640-95c1-78564c4aa441 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:27.263246 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49024041-faa7-4640-95c1-78564c4aa441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:27.271694 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49024041-faa7-4640-95c1-78564c4aa441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:27.273306 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49024041-faa7-4640-95c1-78564c4aa441 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:27.282644 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 567/1130] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:28.109564 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863442-b440-4987-8285-b329b4c28b34 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:28.110062 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863442-b440-4987-8285-b329b4c28b34 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:28.110176 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863442-b440-4987-8285-b329b4c28b34 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:28.111512 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 564/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:28.116220 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7213fd-2f08-4567-944c-40f8bb77c740 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:28.116653 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7213fd-2f08-4567-944c-40f8bb77c740 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:28.116813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7213fd-2f08-4567-944c-40f8bb77c740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:28.134695 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-9a7213fd-2f08-4567-944c-40f8bb77c740 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:28.135963 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-9a7213fd-2f08-4567-944c-40f8bb77c740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:28.144203 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 568/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:40:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:28.311263 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4863442-b440-4987-8285-b329b4c28b34 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:28.325051 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4863442-b440-4987-8285-b329b4c28b34 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:28.329962 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba992a16-abb3-4292-b294-1d71283f60b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:28.330590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba992a16-abb3-4292-b294-1d71283f60b3 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:28.330873 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba992a16-abb3-4292-b294-1d71283f60b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:28.331149 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba992a16-abb3-4292-b294-1d71283f60b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:28.340326 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba992a16-abb3-4292-b294-1d71283f60b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:28.341916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba992a16-abb3-4292-b294-1d71283f60b3 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:28.351151 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 565/1133] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:31.764845 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732784f-bb87-4933-8b7b-2291f89e119a None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:31.765414 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732784f-bb87-4933-8b7b-2291f89e119a None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:31.765414 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732784f-bb87-4933-8b7b-2291f89e119a None None] PATH_INFO: `/v3` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:31.766973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 569/1134] 10.222.0.107 () {54 vars in 926 bytes} [Fri Jul 15 15:40:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:40:31.772963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89151f-03e1-48b4-83e5-39edad2b9f40 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:31.773407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89151f-03e1-48b4-83e5-39edad2b9f40 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:31.773554 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89151f-03e1-48b4-83e5-39edad2b9f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:31.801942 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8e89151f-03e1-48b4-83e5-39edad2b9f40 None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:31.803144 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8e89151f-03e1-48b4-83e5-39edad2b9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:31.856089 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=100 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:31.865609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 566/1135] 10.222.0.107 () {58 vars in 1016 bytes} [Fri Jul 15 15:40:31 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:38.129993 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=42 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:40:39.594911 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94e2-e4b2-4255-845d-2fdad5e23001 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:39.595398 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94e2-e4b2-4255-845d-2fdad5e23001 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:39.595502 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa94e2-e4b2-4255-845d-2fdad5e23001 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:39.596863 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 570/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:39.601641 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62522aa-d65a-4526-92b5-18cdeded9ffc None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:39.602079 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62522aa-d65a-4526-92b5-18cdeded9ffc None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:39.602200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62522aa-d65a-4526-92b5-18cdeded9ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:39.620084 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-a62522aa-d65a-4526-92b5-18cdeded9ffc None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:39.621289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-a62522aa-d65a-4526-92b5-18cdeded9ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:39.629267 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 567/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:40:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:40:39.789934 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa94e2-e4b2-4255-845d-2fdad5e23001 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:39.804270 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa94e2-e4b2-4255-845d-2fdad5e23001 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:39.810896 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6399d-9e94-463e-92d4-aec340e5a889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:39.811530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6399d-9e94-463e-92d4-aec340e5a889 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:39.811842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6399d-9e94-463e-92d4-aec340e5a889 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:39.812122 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6399d-9e94-463e-92d4-aec340e5a889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:39.820398 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6399d-9e94-463e-92d4-aec340e5a889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:39.821983 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6399d-9e94-463e-92d4-aec340e5a889 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:39.832028 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 571/1138] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:40.665803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8f6fe-14ed-4045-b721-c9bd5bf8aef9 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:40.666313 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8f6fe-14ed-4045-b721-c9bd5bf8aef9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:40.666313 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8f6fe-14ed-4045-b721-c9bd5bf8aef9 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:40.667652 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 568/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 15:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:40.673020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249d01-aa28-40f5-b162-61c2099e5dd2 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:40.673446 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249d01-aa28-40f5-b162-61c2099e5dd2 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:40.673579 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65249d01-aa28-40f5-b162-61c2099e5dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:40.683393 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870483f0-6943-40d0-95c0-b45adb561669 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:40.683678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870483f0-6943-40d0-95c0-b45adb561669 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:40.683998 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870483f0-6943-40d0-95c0-b45adb561669 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:40.685535 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 569/1140] 10.222.0.94 () {54 vars in 960 bytes} [Fri Jul 15 15:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:40:40.690374 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335e754-6c23-4ce6-a386-2ab5e52aab00 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:40.690662 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335e754-6c23-4ce6-a386-2ab5e52aab00 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:40.690942 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335e754-6c23-4ce6-a386-2ab5e52aab00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:40.692601 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-65249d01-aa28-40f5-b162-61c2099e5dd2 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:40.693854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-65249d01-aa28-40f5-b162-61c2099e5dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:40.701904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 572/1141] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 15:40:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:40.709523 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7335e754-6c23-4ce6-a386-2ab5e52aab00 None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:40.710451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7335e754-6c23-4ce6-a386-2ab5e52aab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:40.719905 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 570/1142] 10.222.0.94 () {58 vars in 1057 bytes} [Fri Jul 15 15:40:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:40:40.727507 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249d01-aa28-40f5-b162-61c2099e5dd2 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:40.739550 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65249d01-aa28-40f5-b162-61c2099e5dd2 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:40.744763 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae801762-0646-45e4-aec0-62ecadb2690d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975c6f6b7fcd43ef83401317a46fc925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:40.745462 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801762-0646-45e4-aec0-62ecadb2690d service placement] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:40.745750 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801762-0646-45e4-aec0-62ecadb2690d service placement] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:40.746026 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae801762-0646-45e4-aec0-62ecadb2690d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:40.754542 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae801762-0646-45e4-aec0-62ecadb2690d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:40.756242 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae801762-0646-45e4-aec0-62ecadb2690d service placement] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:40.767919 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 573/1143] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:40 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:40.862169 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335e754-6c23-4ce6-a386-2ab5e52aab00 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:40.873245 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335e754-6c23-4ce6-a386-2ab5e52aab00 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:40.878368 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455702d-6f41-4983-820c-aff4097472a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:40.879005 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455702d-6f41-4983-820c-aff4097472a7 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:40.879289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455702d-6f41-4983-820c-aff4097472a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:40.879564 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455702d-6f41-4983-820c-aff4097472a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:40.887967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455702d-6f41-4983-820c-aff4097472a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:40.889534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455702d-6f41-4983-820c-aff4097472a7 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:40.899433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 571/1144] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:45.555629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca1943-2be2-4e7e-b9d2-6ecea030adcd None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:45.556266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca1943-2be2-4e7e-b9d2-6ecea030adcd None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:45.556266 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca1943-2be2-4e7e-b9d2-6ecea030adcd None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:45.557600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:45.563048 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e56a7-b1c0-45ad-8da1-c7e31aced047 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:45.563477 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e56a7-b1c0-45ad-8da1-c7e31aced047 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:45.563612 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e56a7-b1c0-45ad-8da1-c7e31aced047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:45.582068 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-492e56a7-b1c0-45ad-8da1-c7e31aced047 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:45.583296 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-492e56a7-b1c0-45ad-8da1-c7e31aced047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:45.591173 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:40:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:45.628639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca1943-2be2-4e7e-b9d2-6ecea030adcd None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:45.630299 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-73ca1943-2be2-4e7e-b9d2-6ecea030adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:45.689033 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca1943-2be2-4e7e-b9d2-6ecea030adcd None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:45.692537 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802136e-14c8-449c-92d9-76fbd97f901e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:45.693177 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802136e-14c8-449c-92d9-76fbd97f901e service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:45.693464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802136e-14c8-449c-92d9-76fbd97f901e service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:45.693742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802136e-14c8-449c-92d9-76fbd97f901e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:45.703329 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802136e-14c8-449c-92d9-76fbd97f901e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:45.704868 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802136e-14c8-449c-92d9-76fbd97f901e service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:45.714231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 575/1147] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:47.936072 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbdcea-e3e8-4b3f-aaee-44f10b07ea28 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:47.936657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbdcea-e3e8-4b3f-aaee-44f10b07ea28 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:47.936657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbdcea-e3e8-4b3f-aaee-44f10b07ea28 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:47.938110 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 573/1148] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:47.943373 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1644dc-7c88-42bc-8b73-ed696168954f None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:47.943815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1644dc-7c88-42bc-8b73-ed696168954f None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:47.943972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1644dc-7c88-42bc-8b73-ed696168954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:47.961815 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-fc1644dc-7c88-42bc-8b73-ed696168954f None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:47.963018 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-fc1644dc-7c88-42bc-8b73-ed696168954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:47.971004 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 576/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:40:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:48.008475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbdcea-e3e8-4b3f-aaee-44f10b07ea28 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:48.019661 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbdcea-e3e8-4b3f-aaee-44f10b07ea28 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:48.023144 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf47f30-763d-47d2-8ae7-c44edebdf419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:48.023803 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf47f30-763d-47d2-8ae7-c44edebdf419 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:48.024090 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf47f30-763d-47d2-8ae7-c44edebdf419 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:48.024373 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf47f30-763d-47d2-8ae7-c44edebdf419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:48.033718 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf47f30-763d-47d2-8ae7-c44edebdf419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:48.035140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf47f30-763d-47d2-8ae7-c44edebdf419 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:48.044268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 574/1150] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:52.007681 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754fb9-6bbe-427e-88c7-e3b24016307e None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:52.008204 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754fb9-6bbe-427e-88c7-e3b24016307e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:52.008312 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8754fb9-6bbe-427e-88c7-e3b24016307e None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:52.009634 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 577/1151] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:52.015049 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21816dec-c869-44ac-a5ce-b0b10ecb52f5 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:52.015487 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21816dec-c869-44ac-a5ce-b0b10ecb52f5 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:52.015605 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21816dec-c869-44ac-a5ce-b0b10ecb52f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:52.036478 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-21816dec-c869-44ac-a5ce-b0b10ecb52f5 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:52.037684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-21816dec-c869-44ac-a5ce-b0b10ecb52f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:52.046018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 575/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:40:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:52.322129 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754fb9-6bbe-427e-88c7-e3b24016307e None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:52.323874 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-c8754fb9-6bbe-427e-88c7-e3b24016307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:52.380302 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8754fb9-6bbe-427e-88c7-e3b24016307e None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:52.383861 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6bb0e-0579-4b1e-a2f4-107f1285ddef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5904a25265304dc683441c3b110bd1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:52.384507 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bb0e-0579-4b1e-a2f4-107f1285ddef service cinder] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:52.384805 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bb0e-0579-4b1e-a2f4-107f1285ddef service cinder] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:52.385089 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6bb0e-0579-4b1e-a2f4-107f1285ddef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:52.394702 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6bb0e-0579-4b1e-a2f4-107f1285ddef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:52.396172 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6bb0e-0579-4b1e-a2f4-107f1285ddef service cinder] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:52.405950 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 578/1153] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:40:54.659693 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d05e18-6675-4d94-a49f-907780621583 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:54.660269 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d05e18-6675-4d94-a49f-907780621583 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:54.660269 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d05e18-6675-4d94-a49f-907780621583 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:54.661650 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 576/1154] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 15:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:40:54.667160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f196-1ca1-4561-9d0b-6832a7d4f03d None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:54.667620 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f196-1ca1-4561-9d0b-6832a7d4f03d None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:54.667773 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f196-1ca1-4561-9d0b-6832a7d4f03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:54.685393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-ffa2f196-1ca1-4561-9d0b-6832a7d4f03d None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:40:54.686651 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-ffa2f196-1ca1-4561-9d0b-6832a7d4f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:54.695112 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 579/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 15:40:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:40:54.970127 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d05e18-6675-4d94-a49f-907780621583 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:40:54.971795 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-28d05e18-6675-4d94-a49f-907780621583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:40:54.985278 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d05e18-6675-4d94-a49f-907780621583 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:40:54.988744 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdb89d-04a6-46bb-a969-a2c8e2f5f1e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5904a25265304dc683441c3b110bd1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:40:54.989375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdb89d-04a6-46bb-a969-a2c8e2f5f1e5 service cinder] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:40:54.989657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdb89d-04a6-46bb-a969-a2c8e2f5f1e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:40:54.989933 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdb89d-04a6-46bb-a969-a2c8e2f5f1e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:40:54.998756 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdb89d-04a6-46bb-a969-a2c8e2f5f1e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:40:55.000212 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdb89d-04a6-46bb-a969-a2c8e2f5f1e5 service cinder] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:40:55.009383 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 577/1156] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:40:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:41:04.680287 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=73 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:41:05.005354 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=30 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:14.564084 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083f92c-0d34-4ab6-8694-628c0b9a9829 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.564741 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083f92c-0d34-4ab6-8694-628c0b9a9829 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.564741 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083f92c-0d34-4ab6-8694-628c0b9a9829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.568470 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526b93f-a8a9-442e-b6c6-8c37dc06e733 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.568906 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526b93f-a8a9-442e-b6c6-8c37dc06e733 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.569060 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526b93f-a8a9-442e-b6c6-8c37dc06e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.583440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6083f92c-0d34-4ab6-8694-628c0b9a9829 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:14.584689 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6083f92c-0d34-4ab6-8694-628c0b9a9829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:14.587178 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-9526b93f-a8a9-442e-b6c6-8c37dc06e733 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:14.588390 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-9526b93f-a8a9-442e-b6c6-8c37dc06e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:14.593117 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 580/1157] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:14.596660 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 578/1158] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:14.601127 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490167a-a910-4ddd-bc91-e1dcf1972ecf None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.601417 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490167a-a910-4ddd-bc91-e1dcf1972ecf None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.601703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490167a-a910-4ddd-bc91-e1dcf1972ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.604544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1e77-8f88-4bad-ae0a-ef5ce51f0ed1 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.604831 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1e77-8f88-4bad-ae0a-ef5ce51f0ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.605109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c1e77-8f88-4bad-ae0a-ef5ce51f0ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.619498 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-5490167a-a910-4ddd-bc91-e1dcf1972ecf None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:14.620716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-5490167a-a910-4ddd-bc91-e1dcf1972ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:14.622616 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-0c3c1e77-8f88-4bad-ae0a-ef5ce51f0ed1 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:14.623891 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-0c3c1e77-8f88-4bad-ae0a-ef5ce51f0ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:14.628652 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 581/1159] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:14.631861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 579/1160] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:14.633051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490167a-a910-4ddd-bc91-e1dcf1972ecf None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.636281 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c1e77-8f88-4bad-ae0a-ef5ce51f0ed1 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.642973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490167a-a910-4ddd-bc91-e1dcf1972ecf None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.645884 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c1e77-8f88-4bad-ae0a-ef5ce51f0ed1 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.647562 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.648245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.648532 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.648810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] PATH_INFO: `/v3/domains` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.649527 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87248) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:42:14.649842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.650452 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.650873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING py.warnings [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:42:14.650873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: warnings.warn(msg) Jul 15 15:42:14.650873 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: Jul 15 15:42:14.651127 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.651371 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.651647 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.651774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.652432 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87247) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 15:42:14.652738 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.655609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.670904 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 582/1161] 10.222.0.94 () {58 vars in 1152 bytes} [Fri Jul 15 15:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 15:42:14.671696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 580/1162] 10.222.0.94 () {58 vars in 1152 bytes} [Fri Jul 15 15:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 15:42:14.676172 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.676522 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.687002 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c450a0c-fd6b-4afa-800d-7e709168f084 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.687543 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48082eaf-666f-4ab7-86be-1ebdedd207a4 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.691619 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.692156 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.692307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.692595 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.692791 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.692902 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.693074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.693351 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.693582 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.694043 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.695042 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:42:14.695042 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:42:14.695042 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:42:14.695499 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.696262 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.731665 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 583/1163] 10.222.0.94 () {60 vars in 1152 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:42:14.736621 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 581/1164] 10.222.0.94 () {60 vars in 1152 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:42:14.736814 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.737590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.797639 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb601e-e346-427b-8179-be601f61603e admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.801221 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ccabe-5397-49ba-b001-56f74cd4da87 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.802272 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.802939 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.803580 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.803900 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.804600 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.805618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING py.warnings [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:42:14.805618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: warnings.warn(msg) Jul 15 15:42:14.805618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: Jul 15 15:42:14.806112 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.806781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.806886 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.807069 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.807348 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.808087 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.809991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.830018 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 584/1165] 10.222.0.94 () {60 vars in 1143 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:42:14.834390 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 582/1166] 10.222.0.94 () {60 vars in 1143 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 15:42:14.835198 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.835322 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.844963 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b869-bdf0-4451-82e0-2c9591ac5d5c admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.845540 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5345-a555-41c6-a922-3e5747d51c52 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.849774 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.850396 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.850529 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.850706 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.850984 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.851098 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.851309 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.851584 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.851690 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.852572 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.853306 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.854144 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.863392 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 583/1167] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:42:14.867256 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 585/1168] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:42:14.867490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.868382 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.877657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10d0d0-ca05-4f99-ac3a-c40f83b4bcfc admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.878495 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e9c5d-5f3f-46fb-a75c-daade4d6411c admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.882194 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.882832 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.883092 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.883210 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.883371 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.883730 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.884061 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.884185 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.884339 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.885048 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.885655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.886641 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.897317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 584/1169] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:42:14.899786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 586/1170] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:42:14.901298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.902182 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:14.912373 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc838a-cf77-4bb0-a1d4-ce6a4855f900 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.912550 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a3a0d-7f61-45d7-9e64-8cb3b9a36bdd admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:14.916886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bf0fc-08e2-4523-a334-e5c5953f1782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.917033 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960381cd-6bdf-4202-bf8b-fe8a03958f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:14.917750 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf0fc-08e2-4523-a334-e5c5953f1782 admin admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.917892 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960381cd-6bdf-4202-bf8b-fe8a03958f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.918036 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf0fc-08e2-4523-a334-e5c5953f1782 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.918171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960381cd-6bdf-4202-bf8b-fe8a03958f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.918312 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf0fc-08e2-4523-a334-e5c5953f1782 admin admin] PATH_INFO: `/v3/projects/43a612d88d4b4bed8e7330fccb026834/users/1e8435e43a1f456894554e40b8bb2271/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.918435 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960381cd-6bdf-4202-bf8b-fe8a03958f04 admin admin] PATH_INFO: `/v3/projects/9e2418fb1e8147c1836127e3d10536e9/users/fbf85288906b47bdbf128633636cf750/roles/6b04d13512924cf4b057253a13eb63d1` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.933835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bf0fc-08e2-4523-a334-e5c5953f1782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a612d88d4b4bed8e7330fccb026834, user_id=1e8435e43a1f456894554e40b8bb2271, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.934870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-fc8bf0fc-08e2-4523-a334-e5c5953f1782 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:42:14.934870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:42:14.934870 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:42:14.937082 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bf0fc-08e2-4523-a334-e5c5953f1782 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.938242 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960381cd-6bdf-4202-bf8b-fe8a03958f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2418fb1e8147c1836127e3d10536e9, user_id=fbf85288906b47bdbf128633636cf750, role_id=6b04d13512924cf4b057253a13eb63d1)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:14.940990 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960381cd-6bdf-4202-bf8b-fe8a03958f04 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:14.951362 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 585/1171] 10.222.0.94 () {60 vars in 1482 bytes} [Fri Jul 15 15:42:14 2022] PUT /identity/v3/projects/43a612d88d4b4bed8e7330fccb026834/users/1e8435e43a1f456894554e40b8bb2271/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:42:14.954038 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 587/1172] 10.222.0.94 () {60 vars in 1482 bytes} [Fri Jul 15 15:42:14 2022] PUT /identity/v3/projects/9e2418fb1e8147c1836127e3d10536e9/users/fbf85288906b47bdbf128633636cf750/roles/6b04d13512924cf4b057253a13eb63d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:42:14.956731 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.957023 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.957332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.958854 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36362907-9882-4f13-95f3-ff6ccb7499f9 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:14.959145 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36362907-9882-4f13-95f3-ff6ccb7499f9 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:14.959449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36362907-9882-4f13-95f3-ff6ccb7499f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:14.975485 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:14.976289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:14.976918 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-36362907-9882-4f13-95f3-ff6ccb7499f9 None None] MFA Rules not processed for user `1a5c2341cb2b4b2f93d951457ae1d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:14.978101 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-36362907-9882-4f13-95f3-ff6ccb7499f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:15.020411 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:15.020938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:15.040096 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 588/1173] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:15.040629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 586/1174] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:15.050026 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36362907-9882-4f13-95f3-ff6ccb7499f9 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:15.050690 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:15.052111 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:15.104030 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36362907-9882-4f13-95f3-ff6ccb7499f9 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:15.107644 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36448b38-3d9a-4435-9771-e855115f9fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:15.108969 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36448b38-3d9a-4435-9771-e855115f9fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:15.109258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36448b38-3d9a-4435-9771-e855115f9fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:15.109537 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36448b38-3d9a-4435-9771-e855115f9fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:15.118807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36448b38-3d9a-4435-9771-e855115f9fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:15.120279 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36448b38-3d9a-4435-9771-e855115f9fa8 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:15.122575 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9276ea-ab42-4dac-98d5-4aed97d19950 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:15.126260 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f8781-2969-4a94-beb1-303c92a6a641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:15.126899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f8781-2969-4a94-beb1-303c92a6a641 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:15.127180 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f8781-2969-4a94-beb1-303c92a6a641 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:15.127456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f8781-2969-4a94-beb1-303c92a6a641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:15.129880 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 589/1175] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:42:15.136562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f8781-2969-4a94-beb1-303c92a6a641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:15.137991 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f8781-2969-4a94-beb1-303c92a6a641 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:15.148799 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 587/1176] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:42:20.927679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf0526-ef31-4a10-b0b0-27254a15dee3 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:20.928244 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf0526-ef31-4a10-b0b0-27254a15dee3 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:20.928506 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf0526-ef31-4a10-b0b0-27254a15dee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:20.996441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-9aaf0526-ef31-4a10-b0b0-27254a15dee3 None None] MFA Rules not processed for user `fbf85288906b47bdbf128633636cf750`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:20.998360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-9aaf0526-ef31-4a10-b0b0-27254a15dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:21.103816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e201-3690-40d2-9331-f75889540421 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.103816 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e201-3690-40d2-9331-f75889540421 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.104586 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78e201-3690-40d2-9331-f75889540421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.119786 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 590/1177] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:20 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:21.124779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf0526-ef31-4a10-b0b0-27254a15dee3 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.138556 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf0526-ef31-4a10-b0b0-27254a15dee3 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.141781 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-cf78e201-3690-40d2-9331-f75889540421 None None] MFA Rules not processed for user `1e8435e43a1f456894554e40b8bb2271`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:21.143629 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-cf78e201-3690-40d2-9331-f75889540421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:21.145393 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.146898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.148021 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.148255 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] PATH_INFO: `/v3/projects` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.149041 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.151731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.192325 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 591/1178] 10.222.0.94 () {60 vars in 1152 bytes} [Fri Jul 15 15:42:21 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:42:21.193331 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.251207 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 588/1179] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:21 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:21.252771 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78e201-3690-40d2-9331-f75889540421 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.264696 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:21.269882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b876b-da14-42af-8a03-f3585b105962 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.274634 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78e201-3690-40d2-9331-f75889540421 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.277159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.278618 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.279043 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.279429 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] PATH_INFO: `/v3/users` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.280515 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.281229 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.281356 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.281534 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.281793 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] PATH_INFO: `/v3/projects` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.282628 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.284684 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.284835 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.317136 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 592/1180] 10.222.0.94 () {60 vars in 1143 bytes} [Fri Jul 15 15:42:21 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:42:21.323829 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.324332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 589/1181] 10.222.0.94 () {60 vars in 1152 bytes} [Fri Jul 15 15:42:21 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:42:21.328136 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.339239 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528f9f0-c11e-4e65-b703-ec41f67dfc8a admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.386489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:21.403108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff76387-2aba-4972-8fa3-058a5d088847 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.408324 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.408995 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.409311 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.409590 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] PATH_INFO: `/v3/users` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.410197 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.410344 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.411166 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.411640 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.412097 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.412976 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.414726 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.415030 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.429160 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 593/1182] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:42:21.433817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.443175 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 590/1183] 10.222.0.94 () {60 vars in 1143 bytes} [Fri Jul 15 15:42:21 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 15:42:21.444483 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4cc54-ba21-4af2-bcee-91a3a058f2ea admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.453332 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.458366 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.459304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.459595 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.459914 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] PATH_INFO: `/v3/projects/a3a7cfa0dbfc4e48bd6ae2e480c5a759/users/fcc7b9457e5f4aa1928befa3beb1f897/roles/8442e7332b934407beff8c3564575b62` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.467141 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f972517-cdf4-4cc6-8d9f-2dbff53cd051 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.472183 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.472863 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.473153 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.473436 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.474193 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.475847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.477932 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a7cfa0dbfc4e48bd6ae2e480c5a759, user_id=fcc7b9457e5f4aa1928befa3beb1f897, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.480922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.489654 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 591/1184] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 15:42:21.495158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.501975 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 594/1185] 10.222.0.94 () {60 vars in 1482 bytes} [Fri Jul 15 15:42:21 2022] PUT /identity/v3/projects/a3a7cfa0dbfc4e48bd6ae2e480c5a759/users/fcc7b9457e5f4aa1928befa3beb1f897/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:42:21.504969 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.510324 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b4407-af89-4a14-ad39-1821957b91f7 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.581216 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ac782-b2fc-4167-8ed1-d2dda5faa594 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.582916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.583863 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.584158 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.584444 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] PATH_INFO: `/v3/projects/2be3bfeeb43c453e8576fe9f362d835c/users/ca47edfe43534f08a9de100006cff21f/roles/8442e7332b934407beff8c3564575b62` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.598315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.599008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.599447 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.599774 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] PATH_INFO: `/v3/roles` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.600531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.602161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.602657 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be3bfeeb43c453e8576fe9f362d835c, user_id=ca47edfe43534f08a9de100006cff21f, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.605470 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.633344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 595/1186] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:42:21.637053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.637451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 592/1187] 10.222.0.94 () {60 vars in 1482 bytes} [Fri Jul 15 15:42:21 2022] PUT /identity/v3/projects/2be3bfeeb43c453e8576fe9f362d835c/users/ca47edfe43534f08a9de100006cff21f/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:42:21.641389 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.652817 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1af76-0f53-4281-aab3-3c1907a8d55e admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.714745 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7fae-9618-4330-ab05-7d2fd3aa8428 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.715284 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:21.721188 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.721971 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.722370 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.722513 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.723253 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.724992 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.725978 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eb1bc-68f8-4111-920b-f010bb9b8bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.726995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb1bc-68f8-4111-920b-f010bb9b8bca admin admin] REQUEST_METHOD: `PUT` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.727621 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb1bc-68f8-4111-920b-f010bb9b8bca admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.727862 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eb1bc-68f8-4111-920b-f010bb9b8bca admin admin] PATH_INFO: `/v3/projects/a3a7cfa0dbfc4e48bd6ae2e480c5a759/users/fcc7b9457e5f4aa1928befa3beb1f897/roles/8442e7332b934407beff8c3564575b62` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.730035 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb1bc-68f8-4111-920b-f010bb9b8bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a7cfa0dbfc4e48bd6ae2e480c5a759, user_id=fcc7b9457e5f4aa1928befa3beb1f897, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.733680 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eb1bc-68f8-4111-920b-f010bb9b8bca admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.737614 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 593/1188] 10.222.0.94 () {58 vars in 1121 bytes} [Fri Jul 15 15:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 15:42:21.745200 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:21.750890 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 596/1189] 10.222.0.94 () {60 vars in 1482 bytes} [Fri Jul 15 15:42:21 2022] PUT /identity/v3/projects/a3a7cfa0dbfc4e48bd6ae2e480c5a759/users/fcc7b9457e5f4aa1928befa3beb1f897/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 15:42:21.760050 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abac8d2-bb23-4ae6-b48d-45c2d738d8a7 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:21.812841 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:21.835388 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e74e63-12ee-424d-b2ac-5bb0b06e4f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:21.836633 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e74e63-12ee-424d-b2ac-5bb0b06e4f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:21.837033 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e74e63-12ee-424d-b2ac-5bb0b06e4f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:21.837424 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e74e63-12ee-424d-b2ac-5bb0b06e4f8c admin admin] PATH_INFO: `/v3/projects/2be3bfeeb43c453e8576fe9f362d835c/users/ca47edfe43534f08a9de100006cff21f/roles/8442e7332b934407beff8c3564575b62` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:21.839975 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e74e63-12ee-424d-b2ac-5bb0b06e4f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be3bfeeb43c453e8576fe9f362d835c, user_id=ca47edfe43534f08a9de100006cff21f, role_id=8442e7332b934407beff8c3564575b62)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:21.843552 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e74e63-12ee-424d-b2ac-5bb0b06e4f8c admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:21.857257 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 594/1190] 10.222.0.94 () {60 vars in 1482 bytes} [Fri Jul 15 15:42:21 2022] PUT /identity/v3/projects/2be3bfeeb43c453e8576fe9f362d835c/users/ca47edfe43534f08a9de100006cff21f/roles/8442e7332b934407beff8c3564575b62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:42:28.057245 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:28.057861 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:28.058226 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:28.108986 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] MFA Rules not processed for user `ca47edfe43534f08a9de100006cff21f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:28.117994 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:28.254206 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:28.259392 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 597/1191] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:28 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:28.263546 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:28.264842 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:28.278006 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:28.280177 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:28.310092 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] MFA Rules not processed for user `fcc7b9457e5f4aa1928befa3beb1f897`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:28.311787 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:28.394360 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e541e4-84dc-4fd6-851d-c3682a645bb8 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:28.398675 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c539-52b5-41bc-badb-a679da84bd7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c96f27d72744e5fb22cbe798a0cb98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:28.399466 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c539-52b5-41bc-badb-a679da84bd7a service glance] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:28.399883 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c539-52b5-41bc-badb-a679da84bd7a service glance] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:28.400262 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c539-52b5-41bc-badb-a679da84bd7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:28.448169 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 595/1192] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:28 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:28.460741 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:28.462678 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:28.488460 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efaf3-d55b-4136-a5b6-4be3d9574177 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:28.493998 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080d423-82f2-4d18-bdf0-5d427dc7c23e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c96f27d72744e5fb22cbe798a0cb98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:28.494847 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080d423-82f2-4d18-bdf0-5d427dc7c23e service glance] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:28.495152 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080d423-82f2-4d18-bdf0-5d427dc7c23e service glance] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:28.495427 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080d423-82f2-4d18-bdf0-5d427dc7c23e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:28.504443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c539-52b5-41bc-badb-a679da84bd7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:28.506175 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c539-52b5-41bc-badb-a679da84bd7a service glance] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:28.530053 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 598/1193] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:28 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:42:28.631403 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080d423-82f2-4d18-bdf0-5d427dc7c23e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:28.633042 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080d423-82f2-4d18-bdf0-5d427dc7c23e service glance] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:28.648947 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 596/1194] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:28 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:42:37.184647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90098524-a5e4-4522-a44b-f5291968bb71 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:37.186315 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90098524-a5e4-4522-a44b-f5291968bb71 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:37.186839 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90098524-a5e4-4522-a44b-f5291968bb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:37.209931 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-90098524-a5e4-4522-a44b-f5291968bb71 None None] MFA Rules not processed for user `fbf85288906b47bdbf128633636cf750`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:37.211191 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-90098524-a5e4-4522-a44b-f5291968bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:37.224108 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 599/1195] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:42:37 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:37.574103 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006adb34-df14-44c4-8bc7-cf7877e13bcf None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:37.574667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006adb34-df14-44c4-8bc7-cf7877e13bcf None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:37.574667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006adb34-df14-44c4-8bc7-cf7877e13bcf None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:37.576667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 597/1196] 10.222.0.94 () {54 vars in 961 bytes} [Fri Jul 15 15:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:42:37.581972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77a48-08ea-4309-8fbe-547c72785a8e None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:37.582331 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77a48-08ea-4309-8fbe-547c72785a8e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:37.582691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed77a48-08ea-4309-8fbe-547c72785a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:37.600837 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:37.620400 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-bed77a48-08ea-4309-8fbe-547c72785a8e None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:37.621614 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-bed77a48-08ea-4309-8fbe-547c72785a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:37.690145 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 600/1197] 10.222.0.94 () {58 vars in 1058 bytes} [Fri Jul 15 15:42:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:37.695759 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e876-9e96-46c3-8c92-edeb2798403e None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:37.696273 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e876-9e96-46c3-8c92-edeb2798403e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:37.696742 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890e876-9e96-46c3-8c92-edeb2798403e None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:37.698576 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 598/1198] 10.222.0.94 () {54 vars in 912 bytes} [Fri Jul 15 15:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:42:37.703828 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bf70c-26f6-442f-b6f1-f7ef59731931 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:37.704126 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bf70c-26f6-442f-b6f1-f7ef59731931 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:37.704432 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bf70c-26f6-442f-b6f1-f7ef59731931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:37.722781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-fa3bf70c-26f6-442f-b6f1-f7ef59731931 None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:37.724031 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-fa3bf70c-26f6-442f-b6f1-f7ef59731931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:37.733213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 601/1199] 10.222.0.94 () {58 vars in 1009 bytes} [Fri Jul 15 15:42:37 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:37.744899 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890e876-9e96-46c3-8c92-edeb2798403e None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:37.757041 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890e876-9e96-46c3-8c92-edeb2798403e None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:37.761212 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afa17f-f0cd-47c5-8d2a-6a63615044ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c96f27d72744e5fb22cbe798a0cb98e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:37.762375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afa17f-f0cd-47c5-8d2a-6a63615044ec service glance] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:37.762718 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afa17f-f0cd-47c5-8d2a-6a63615044ec service glance] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:37.763035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afa17f-f0cd-47c5-8d2a-6a63615044ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:37.774532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afa17f-f0cd-47c5-8d2a-6a63615044ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:37.776014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afa17f-f0cd-47c5-8d2a-6a63615044ec service glance] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:37.788510 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 599/1200] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:42:38.137018 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c592-c5b9-4452-a843-800f29cfb599 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.137415 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c592-c5b9-4452-a843-800f29cfb599 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.137698 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c592-c5b9-4452-a843-800f29cfb599 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.139183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 602/1201] 10.222.0.94 () {54 vars in 912 bytes} [Fri Jul 15 15:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:42:38.144825 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584b11-b030-4eca-84e3-30e94586c041 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.145227 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584b11-b030-4eca-84e3-30e94586c041 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.145645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584b11-b030-4eca-84e3-30e94586c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.164957 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-51584b11-b030-4eca-84e3-30e94586c041 None None] MFA Rules not processed for user `8a31482a8d184d81a5569d11fcc53181`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:38.166307 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-51584b11-b030-4eca-84e3-30e94586c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:38.212290 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:38.221347 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 600/1202] 10.222.0.94 () {58 vars in 1009 bytes} [Fri Jul 15 15:42:38 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:38.233059 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c592-c5b9-4452-a843-800f29cfb599 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:38.243859 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c592-c5b9-4452-a843-800f29cfb599 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:38.247336 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e06890-6040-4798-9476-2cc2bd4116fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:38.248007 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06890-6040-4798-9476-2cc2bd4116fc service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.248290 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06890-6040-4798-9476-2cc2bd4116fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.248572 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e06890-6040-4798-9476-2cc2bd4116fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.255912 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06890-6040-4798-9476-2cc2bd4116fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:38.257337 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e06890-6040-4798-9476-2cc2bd4116fc service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:38.266633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 603/1203] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:38 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:42:38.649108 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b79242-e04d-4831-b30a-f94086b757a3 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.649680 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b79242-e04d-4831-b30a-f94086b757a3 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.649680 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b79242-e04d-4831-b30a-f94086b757a3 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.651038 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 601/1204] 10.222.0.94 () {54 vars in 961 bytes} [Fri Jul 15 15:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:42:38.660240 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66f6c2-6cff-4b25-88b4-ab5dcfb8049b None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.660530 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66f6c2-6cff-4b25-88b4-ab5dcfb8049b None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.660810 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66f6c2-6cff-4b25-88b4-ab5dcfb8049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.684317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f166e-cc23-46ca-9510-d833404d329a None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.684609 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f166e-cc23-46ca-9510-d833404d329a None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.684950 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f166e-cc23-46ca-9510-d833404d329a None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.686666 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 602/1205] 10.222.0.94 () {54 vars in 960 bytes} [Fri Jul 15 15:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 15:42:38.692137 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-8e66f6c2-6cff-4b25-88b4-ab5dcfb8049b None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:38.692317 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35709815-24ba-4aaf-952b-d62abd59d8de None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.692671 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35709815-24ba-4aaf-952b-d62abd59d8de None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.693067 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35709815-24ba-4aaf-952b-d62abd59d8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.693368 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-8e66f6c2-6cff-4b25-88b4-ab5dcfb8049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:38.704310 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 604/1206] 10.222.0.94 () {58 vars in 1058 bytes} [Fri Jul 15 15:42:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:38.710231 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c886340-e0fe-40f2-9f09-9bded80c4597 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.710528 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c886340-e0fe-40f2-9f09-9bded80c4597 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.710807 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c886340-e0fe-40f2-9f09-9bded80c4597 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.712136 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 605/1207] 10.222.0.94 () {54 vars in 912 bytes} [Fri Jul 15 15:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:42:38.715483 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-35709815-24ba-4aaf-952b-d62abd59d8de None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:38.717384 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-35709815-24ba-4aaf-952b-d62abd59d8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:38.717857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd55d2-2f90-4c1b-bf4c-ab7dd5a44666 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.718251 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd55d2-2f90-4c1b-bf4c-ab7dd5a44666 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.718637 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd55d2-2f90-4c1b-bf4c-ab7dd5a44666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.740011 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-0ecd55d2-2f90-4c1b-bf4c-ab7dd5a44666 None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:38.741197 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-0ecd55d2-2f90-4c1b-bf4c-ab7dd5a44666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:38.750234 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 606/1208] 10.222.0.94 () {58 vars in 1009 bytes} [Fri Jul 15 15:42:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:38.762362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd55d2-2f90-4c1b-bf4c-ab7dd5a44666 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:38.772172 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd55d2-2f90-4c1b-bf4c-ab7dd5a44666 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:38.776291 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab41b0-9753-4e63-beea-e709f78341d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:38.777303 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab41b0-9753-4e63-beea-e709f78341d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.777749 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab41b0-9753-4e63-beea-e709f78341d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.778171 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab41b0-9753-4e63-beea-e709f78341d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.786329 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 603/1209] 10.222.0.94 () {58 vars in 1057 bytes} [Fri Jul 15 15:42:38 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:42:38.789094 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab41b0-9753-4e63-beea-e709f78341d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:38.790685 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab41b0-9753-4e63-beea-e709f78341d3 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:38.796142 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35709815-24ba-4aaf-952b-d62abd59d8de None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:38.802531 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 607/1210] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:42:38.807482 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35709815-24ba-4aaf-952b-d62abd59d8de None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:38.813399 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975c6f6b7fcd43ef83401317a46fc925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:38.814050 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:38.814337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:38.814617 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:38.816430 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:38.828400 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:38.829967 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:38.840553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 604/1211] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:42:48.797870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=50 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:48.836475 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=36 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:42:50.680870 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f65341-4394-4c10-90dd-dc65725e67cc None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:50.681449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f65341-4394-4c10-90dd-dc65725e67cc None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:50.681449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f65341-4394-4c10-90dd-dc65725e67cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:50.700464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-16f65341-4394-4c10-90dd-dc65725e67cc None None] MFA Rules not processed for user `8a31482a8d184d81a5569d11fcc53181`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:50.701683 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-16f65341-4394-4c10-90dd-dc65725e67cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:50.708811 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 608/1212] 10.222.0.107 () {58 vars in 1016 bytes} [Fri Jul 15 15:42:50 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:50.722085 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:50.733922 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e166-fdce-47f0-9daf-5ddf90f08cde service placement] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:50.737583 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ee375-a18c-49f8-9620-ce1a83487fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:50.738231 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee375-a18c-49f8-9620-ce1a83487fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:50.738553 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee375-a18c-49f8-9620-ce1a83487fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:50.738838 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ee375-a18c-49f8-9620-ce1a83487fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:50.746133 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ee375-a18c-49f8-9620-ce1a83487fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:50.747942 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ee375-a18c-49f8-9620-ce1a83487fa0 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:50.755973 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 605/1213] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:50 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:42:51.569161 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2bc0d-0346-4b6d-a627-9d51da2ecf15 None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:51.570068 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2bc0d-0346-4b6d-a627-9d51da2ecf15 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:51.570831 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2bc0d-0346-4b6d-a627-9d51da2ecf15 None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:51.571974 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 609/1214] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:42:51.634369 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110b54-728c-4132-983e-198c88024ba9 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:51.634668 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110b54-728c-4132-983e-198c88024ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:51.634938 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110b54-728c-4132-983e-198c88024ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:51.662686 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-62110b54-728c-4132-983e-198c88024ba9 None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:51.664012 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-62110b54-728c-4132-983e-198c88024ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:51.675771 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 606/1215] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:42:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:51.689663 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2bc0d-0346-4b6d-a627-9d51da2ecf15 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:51.707622 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2bc0d-0346-4b6d-a627-9d51da2ecf15 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:51.718924 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822901d-a951-4119-b375-e54307f0bc84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:51.719658 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822901d-a951-4119-b375-e54307f0bc84 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:51.720147 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822901d-a951-4119-b375-e54307f0bc84 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:51.720440 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822901d-a951-4119-b375-e54307f0bc84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:51.733503 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822901d-a951-4119-b375-e54307f0bc84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:51.735116 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822901d-a951-4119-b375-e54307f0bc84 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:51.746013 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 610/1216] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:51 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:42:57.891656 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b81fc-0f40-4cd8-ae50-12b3deba596a None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:57.892320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b81fc-0f40-4cd8-ae50-12b3deba596a None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:57.892320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b81fc-0f40-4cd8-ae50-12b3deba596a None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:57.893667 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 607/1217] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:42:57.902894 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe951-d119-4daf-ac1f-ba1507cc02d2 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:57.903493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe951-d119-4daf-ac1f-ba1507cc02d2 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:57.903627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe951-d119-4daf-ac1f-ba1507cc02d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:57.924876 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-a4dfe951-d119-4daf-ac1f-ba1507cc02d2 None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:42:57.926099 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-a4dfe951-d119-4daf-ac1f-ba1507cc02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:42:57.938586 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 611/1218] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:42:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:42:57.951140 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b81fc-0f40-4cd8-ae50-12b3deba596a None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:42:57.966890 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b81fc-0f40-4cd8-ae50-12b3deba596a None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:42:57.973684 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7a16-5514-47cc-9003-3cfe24830847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:42:57.977027 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7a16-5514-47cc-9003-3cfe24830847 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:42:57.977320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7a16-5514-47cc-9003-3cfe24830847 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:42:57.977604 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7a16-5514-47cc-9003-3cfe24830847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:42:57.987552 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac7a16-5514-47cc-9003-3cfe24830847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:42:57.989241 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac7a16-5514-47cc-9003-3cfe24830847 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:42:58.000119 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 608/1219] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:42:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:43:07.919282 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=12 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:07.994857 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=15 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:09.431921 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe951-d119-4daf-ac1f-ba1507cc02d2 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:43:09.442303 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfe951-d119-4daf-ac1f-ba1507cc02d2 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:43:09.446095 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f87873-64ce-4d99-8a8f-a5479fc17026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:43:09.446793 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87873-64ce-4d99-8a8f-a5479fc17026 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:43:09.447067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87873-64ce-4d99-8a8f-a5479fc17026 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:43:09.447350 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87873-64ce-4d99-8a8f-a5479fc17026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:43:09.457443 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f87873-64ce-4d99-8a8f-a5479fc17026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:43:09.458882 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f87873-64ce-4d99-8a8f-a5479fc17026 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:43:09.469072 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 612/1220] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:43:09 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:43:11.565476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0133e4-ebda-4cd6-b17c-a36239a2e389 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:43:11.566114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0133e4-ebda-4cd6-b17c-a36239a2e389 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:43:11.566114 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0133e4-ebda-4cd6-b17c-a36239a2e389 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:43:11.567407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 609/1221] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:43:11.574085 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0b9e-c01c-4f8b-8e10-d3731e79c56e None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:43:11.574713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0b9e-c01c-4f8b-8e10-d3731e79c56e None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:43:11.574713 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc0b9e-c01c-4f8b-8e10-d3731e79c56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:43:11.596982 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-a3cc0b9e-c01c-4f8b-8e10-d3731e79c56e None None] MFA Rules not processed for user `1cebf7555312469984252513f450b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:43:11.598403 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-a3cc0b9e-c01c-4f8b-8e10-d3731e79c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:43:11.613616 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 613/1222] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:43:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:43:11.623514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0133e4-ebda-4cd6-b17c-a36239a2e389 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:43:11.645184 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0133e4-ebda-4cd6-b17c-a36239a2e389 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:43:11.650829 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7cb72-655f-4970-af2d-e68d25de2da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:43:11.652298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7cb72-655f-4970-af2d-e68d25de2da5 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:43:11.653360 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7cb72-655f-4970-af2d-e68d25de2da5 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:43:11.653860 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7cb72-655f-4970-af2d-e68d25de2da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:43:11.667222 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7cb72-655f-4970-af2d-e68d25de2da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:43:11.670489 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7cb72-655f-4970-af2d-e68d25de2da5 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:43:11.683999 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 610/1223] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:43:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:43:21.591089 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=9 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:21.677347 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=6 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:26.460866 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e93be-d0b3-4fc5-8106-0f5341f47c64 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:43:26.461400 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e93be-d0b3-4fc5-8106-0f5341f47c64 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:43:26.461400 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e93be-d0b3-4fc5-8106-0f5341f47c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:43:26.478488 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-0e3e93be-d0b3-4fc5-8106-0f5341f47c64 None None] MFA Rules not processed for user `1e8435e43a1f456894554e40b8bb2271`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:43:26.479667 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-0e3e93be-d0b3-4fc5-8106-0f5341f47c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:43:26.487260 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 614/1224] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:43:26 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:43:36.473535 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:43:50.520244 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c6f9c-d92f-4af2-b7eb-e8a4996c5b4f None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:43:50.520801 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c6f9c-d92f-4af2-b7eb-e8a4996c5b4f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:43:50.521109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c6f9c-d92f-4af2-b7eb-e8a4996c5b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:43:50.541286 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-412c6f9c-d92f-4af2-b7eb-e8a4996c5b4f None None] MFA Rules not processed for user `1e8435e43a1f456894554e40b8bb2271`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:43:50.542501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-412c6f9c-d92f-4af2-b7eb-e8a4996c5b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:43:50.549555 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 611/1225] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:43:50 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 15:44:00.536035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:03.973258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1828-6829-4e4f-afda-b4a02487d381 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:44:03.973732 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1828-6829-4e4f-afda-b4a02487d381 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:44:03.973935 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a1828-6829-4e4f-afda-b4a02487d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:44:03.992167 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-aa6a1828-6829-4e4f-afda-b4a02487d381 None None] MFA Rules not processed for user `1e8435e43a1f456894554e40b8bb2271`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:44:03.993369 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-aa6a1828-6829-4e4f-afda-b4a02487d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:44:04.000629 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 615/1226] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:44:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:44:04.267074 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6f61-1ee7-41de-8401-86bd6c8d197f None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:44:04.267542 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6f61-1ee7-41de-8401-86bd6c8d197f None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:44:04.267645 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6f61-1ee7-41de-8401-86bd6c8d197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:44:04.285468 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-ac2a6f61-1ee7-41de-8401-86bd6c8d197f None None] MFA Rules not processed for user `8a31482a8d184d81a5569d11fcc53181`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:44:04.286647 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-ac2a6f61-1ee7-41de-8401-86bd6c8d197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:44:04.293045 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 612/1227] 10.222.0.94 () {58 vars in 1009 bytes} [Fri Jul 15 15:44:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:44:04.304174 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a1828-6829-4e4f-afda-b4a02487d381 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:44:04.314351 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a1828-6829-4e4f-afda-b4a02487d381 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:44:04.317857 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:44:04.318493 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:44:04.318776 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:44:04.319049 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:44:04.326865 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:44:04.328327 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:44:04.335883 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 616/1228] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:44:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:44:14.280391 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:44:14.332578 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=9 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:02.568682 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f686d-50af-4e53-b5f7-be854a05c0fe None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:45:02.569165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f686d-50af-4e53-b5f7-be854a05c0fe None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:45:02.569251 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f686d-50af-4e53-b5f7-be854a05c0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:45:02.586405 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-7e2f686d-50af-4e53-b5f7-be854a05c0fe None None] MFA Rules not processed for user `1e8435e43a1f456894554e40b8bb2271`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:45:02.587688 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-7e2f686d-50af-4e53-b5f7-be854a05c0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:45:02.594620 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 613/1229] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:45:02 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:45:12.581345 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=3 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:45:14.383233 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:45:14.401616 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f44b3e-5644-4ce9-ae5b-055a48698499 service neutron] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:45:14.405145 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f897401-ea07-4998-bc6a-09dfa8fa9ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:45:14.405785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f897401-ea07-4998-bc6a-09dfa8fa9ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:45:14.406067 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f897401-ea07-4998-bc6a-09dfa8fa9ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:45:14.406343 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f897401-ea07-4998-bc6a-09dfa8fa9ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:45:14.417358 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f897401-ea07-4998-bc6a-09dfa8fa9ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:45:14.418785 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f897401-ea07-4998-bc6a-09dfa8fa9ae1 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:45:14.428636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 617/1230] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:45:14 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:45:24.423998 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=10 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:46:35.973347 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f686d-50af-4e53-b5f7-be854a05c0fe None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:46:35.996066 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f686d-50af-4e53-b5f7-be854a05c0fe None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:46:36.001032 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3010a8-5e72-47ff-9fab-3608e6f580e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975c6f6b7fcd43ef83401317a46fc925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:46:36.002234 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3010a8-5e72-47ff-9fab-3608e6f580e8 service placement] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:46:36.002519 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3010a8-5e72-47ff-9fab-3608e6f580e8 service placement] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:46:36.002801 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3010a8-5e72-47ff-9fab-3608e6f580e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:46:36.011190 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3010a8-5e72-47ff-9fab-3608e6f580e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:46:36.013061 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3010a8-5e72-47ff-9fab-3608e6f580e8 service placement] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:46:36.023320 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 614/1231] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:46:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:46:46.019387 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=10 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:00.607129 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e537ec1-a333-4138-b4d8-cbfaabc09364 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:47:00.607674 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e537ec1-a333-4138-b4d8-cbfaabc09364 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:47:00.607804 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e537ec1-a333-4138-b4d8-cbfaabc09364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:47:00.624591 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-6e537ec1-a333-4138-b4d8-cbfaabc09364 None None] MFA Rules not processed for user `fbf85288906b47bdbf128633636cf750`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:47:00.625779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-6e537ec1-a333-4138-b4d8-cbfaabc09364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:47:00.633669 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 618/1232] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:47:00 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:47:10.619716 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=3 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:26.032353 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05debd1-95eb-4093-99a0-968e0ab9f21e None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:47:26.033394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05debd1-95eb-4093-99a0-968e0ab9f21e None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:47:26.033394 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05debd1-95eb-4093-99a0-968e0ab9f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:47:26.053076 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-d05debd1-95eb-4093-99a0-968e0ab9f21e None None] MFA Rules not processed for user `1e8435e43a1f456894554e40b8bb2271`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:47:26.054298 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-d05debd1-95eb-4093-99a0-968e0ab9f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:47:26.061411 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 615/1233] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:47:26 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:47:28.757967 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e537ec1-a333-4138-b4d8-cbfaabc09364 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:47:28.769258 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e537ec1-a333-4138-b4d8-cbfaabc09364 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:47:28.777544 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:47:28.778221 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:47:28.779133 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:47:28.779569 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:47:28.805711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:47:28.810347 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:47:28.831303 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 619/1234] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:47:28 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:47:29.068407 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05debd1-95eb-4093-99a0-968e0ab9f21e None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:47:29.097521 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05debd1-95eb-4093-99a0-968e0ab9f21e None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:47:29.103861 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:47:29.105006 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:47:29.105490 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:47:29.105983 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:47:29.117274 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:47:29.119109 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:47:29.130504 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 616/1235] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:47:29 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:47:37.912662 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:47:37.920877 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a133ee-1423-4e55-83fa-18cbbbda18be service neutron] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:47:37.924441 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:47:37.925069 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:47:37.925352 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:47:37.925627 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:47:37.934710 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:47:37.936154 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:47:37.946633 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 620/1236] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:47:37 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:47:39.125148 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=13 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:47.942373 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=12 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:47:54.630584 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:47:54.640955 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3719b67-ffb4-4d59-b25c-1c32a190a5f2 service nova] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:47:54.645476 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:47:54.649052 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:47:54.649542 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:47:54.649802 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:47:54.660058 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:47:54.661501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:47:54.671449 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:47:54.672014 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 617/1237] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:47:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:47:54.680090 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4845-d318-475d-a63d-36cb42eadb72 service neutron] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:47:54.684267 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:47:54.684917 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:47:54.685209 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:47:54.685494 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:47:54.693868 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:47:54.695311 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:47:54.703653 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 621/1238] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:47:54 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 15:48:04.667376 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=6 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:48:04.699912 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=6 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:48:39.890337 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:39.908403 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e797-f8f5-4585-91df-02876bc82e06 service neutron] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:39.916574 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:39.917291 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:39.917696 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:39.918035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:39.937289 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:39.938979 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:39.953918 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 618/1239] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:48:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:48:41.038555 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:41.063977 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff91c4-ef2d-48e8-8e4e-57bf6df93401 service neutron] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:41.072996 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7e56d-468b-4ec4-b36b-0efe3e217f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:41.073915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e56d-468b-4ec4-b36b-0efe3e217f86 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:41.074211 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e56d-468b-4ec4-b36b-0efe3e217f86 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:41.074566 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7e56d-468b-4ec4-b36b-0efe3e217f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:41.086978 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e56d-468b-4ec4-b36b-0efe3e217f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:41.088642 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7e56d-468b-4ec4-b36b-0efe3e217f86 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:41.102758 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 622/1240] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:48:41 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:48:47.599698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:47.608689 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0135c7e-0c17-4885-b336-485e08c25684 service nova] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:47.612224 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601598bc-fd70-47d8-9e82-d0f248198aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:47.612853 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601598bc-fd70-47d8-9e82-d0f248198aab service neutron] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:47.613134 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601598bc-fd70-47d8-9e82-d0f248198aab service neutron] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:47.613413 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601598bc-fd70-47d8-9e82-d0f248198aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:47.673451 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601598bc-fd70-47d8-9e82-d0f248198aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:47.674886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601598bc-fd70-47d8-9e82-d0f248198aab service neutron] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:47.693501 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 619/1241] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:48:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:48:50.842860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec06fd-a37d-4643-9a29-cd6bf2ce66ab None None] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:50.843456 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec06fd-a37d-4643-9a29-cd6bf2ce66ab None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:50.843456 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec06fd-a37d-4643-9a29-cd6bf2ce66ab None None] PATH_INFO: `/` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:50.844922 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 623/1242] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:48:50.856836 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a402-b255-47f9-b7e7-76f049d20796 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:50.857319 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a402-b255-47f9-b7e7-76f049d20796 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:50.857433 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69a402-b255-47f9-b7e7-76f049d20796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:50.918681 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-cd69a402-b255-47f9-b7e7-76f049d20796 None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:48:50.919802 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-cd69a402-b255-47f9-b7e7-76f049d20796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:48:50.928829 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 620/1243] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:48:50 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:48:50.973679 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec06fd-a37d-4643-9a29-cd6bf2ce66ab None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:50.988218 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec06fd-a37d-4643-9a29-cd6bf2ce66ab None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:50.993742 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975c6f6b7fcd43ef83401317a46fc925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:50.994455 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:50.995008 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:50.995361 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:51.005184 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:51.006784 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:51.016911 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 624/1244] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:48:50 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:48:54.019367 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69a402-b255-47f9-b7e7-76f049d20796 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:54.030838 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69a402-b255-47f9-b7e7-76f049d20796 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:54.035481 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:54.036880 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:54.036880 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:54.037035 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] PATH_INFO: `/v3/users/fbf85288906b47bdbf128633636cf750` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:54.038126 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf85288906b47bdbf128633636cf750)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:54.039726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: WARNING py.warnings [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:48:54.039726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: warnings.warn(msg) Jul 15 15:48:54.039726 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: Jul 15 15:48:54.040977 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:54.102709 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf85288906b47bdbf128633636cf750'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.113255 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf85288906b47bdbf128633636cf750'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.131544 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf85288906b47bdbf128633636cf750'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.132623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf85288906b47bdbf128633636cf750'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.133240 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf85288906b47bdbf128633636cf750'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.145810 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 621/1245] 10.222.0.94 () {58 vars in 1223 bytes} [Fri Jul 15 15:48:54 2022] DELETE /identity/v3/users/fbf85288906b47bdbf128633636cf750 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:48:54.319185 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:54.329703 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a3ad-2c29-42d1-ba37-d8a7edc1fd16 service placement] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:54.386034 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:54.386888 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:54.387170 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:54.387468 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] PATH_INFO: `/v3/projects/9e2418fb1e8147c1836127e3d10536e9` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:54.388711 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2418fb1e8147c1836127e3d10536e9)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:54.389796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: WARNING py.warnings [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 15:48:54.389796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: warnings.warn(msg) Jul 15 15:48:54.389796 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: Jul 15 15:48:54.390967 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:54.445304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2418fb1e8147c1836127e3d10536e9', 'request_id': 'req-5462ea40-245c-45d2-b6b3-a19c0d708fd1'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.458242 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2418fb1e8147c1836127e3d10536e9', 'request_id': 'req-5462ea40-245c-45d2-b6b3-a19c0d708fd1'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.464813 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2418fb1e8147c1836127e3d10536e9', 'request_id': 'req-5462ea40-245c-45d2-b6b3-a19c0d708fd1'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.477344 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] The token cache is being invalidate because project 9e2418fb1e8147c1836127e3d10536e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87248) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:48:54.478111 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.478731 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.480307 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 625/1246] 10.222.0.94 () {58 vars in 1232 bytes} [Fri Jul 15 15:48:54 2022] DELETE /identity/v3/projects/9e2418fb1e8147c1836127e3d10536e9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:48:54.484484 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:54.485866 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:48:54.495416 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:48:54.499230 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869a345-4280-4d24-ac78-bd6920b00b76 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:54.556418 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:54.557292 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:54.557579 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:54.557856 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] PATH_INFO: `/v3/users/fcc7b9457e5f4aa1928befa3beb1f897` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:54.559046 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc7b9457e5f4aa1928befa3beb1f897)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:54.561005 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:54.607233 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc7b9457e5f4aa1928befa3beb1f897'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.614008 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc7b9457e5f4aa1928befa3beb1f897'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.625540 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc7b9457e5f4aa1928befa3beb1f897'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.626215 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc7b9457e5f4aa1928befa3beb1f897'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.626821 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c75e6680-90e1-4a69-99a5-510b727b4afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc7b9457e5f4aa1928befa3beb1f897'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.640383 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 622/1247] 10.222.0.94 () {58 vars in 1223 bytes} [Fri Jul 15 15:48:54 2022] DELETE /identity/v3/users/fcc7b9457e5f4aa1928befa3beb1f897 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:48:54.811150 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:48:54.812750 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:48:54.825898 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ea40-245c-45d2-b6b3-a19c0d708fd1 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:48:54.881973 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:48:54.883383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:48:54.883668 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:48:54.883972 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] PATH_INFO: `/v3/projects/a3a7cfa0dbfc4e48bd6ae2e480c5a759` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:48:54.885142 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a7cfa0dbfc4e48bd6ae2e480c5a759)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:48:54.887047 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:48:54.893159 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:48:54.933400 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a7cfa0dbfc4e48bd6ae2e480c5a759', 'request_id': 'req-1c919512-7f27-4a99-a277-cdb7bff849f0'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.939395 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a7cfa0dbfc4e48bd6ae2e480c5a759', 'request_id': 'req-1c919512-7f27-4a99-a277-cdb7bff849f0'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.945346 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a7cfa0dbfc4e48bd6ae2e480c5a759', 'request_id': 'req-1c919512-7f27-4a99-a277-cdb7bff849f0'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.957173 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] The token cache is being invalidate because project a3a7cfa0dbfc4e48bd6ae2e480c5a759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87248) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:48:54.957464 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.958087 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:48:54.963069 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 626/1248] 10.222.0.94 () {58 vars in 1232 bytes} [Fri Jul 15 15:48:54 2022] DELETE /identity/v3/projects/a3a7cfa0dbfc4e48bd6ae2e480c5a759 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:49:04.636885 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:04.954374 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:22.289780 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] REQUEST_METHOD: `POST` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:49:22.290268 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:49:22.290375 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:49:22.308122 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.auth.core [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] MFA Rules not processed for user `1e8435e43a1f456894554e40b8bb2271`. Rule list: `[]` (Enabled: `True`). {{(pid=87247) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:49:22.309321 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:49:22.362456 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 623/1249] 10.222.0.94 () {58 vars in 957 bytes} [Fri Jul 15 15:49:22 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:49:22.674722 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:49:22.676285 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:49:22.733105 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919512-7f27-4a99-a277-cdb7bff849f0 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:49:22.737054 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:49:22.737644 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:49:22.737930 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:49:22.738217 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:49:22.739995 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:49:22.749362 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:49:22.750781 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:49:22.759213 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 627/1250] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:49:22 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:49:23.216699 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:49:23.218150 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:49:23.294366 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53d82-f78a-4208-821b-8e80e55a7844 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:49:23.299514 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975c6f6b7fcd43ef83401317a46fc925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:49:23.300203 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:49:23.300495 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:49:23.300777 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:49:23.302549 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:49:23.313569 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:49:23.315165 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:49:23.324807 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 624/1251] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:49:23 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:49:31.786051 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:49:31.787466 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:49:31.862496 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674da2-6218-4c0c-80ff-4412aa45d1f9 service neutron] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:49:31.867663 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cebf7555312469984252513f450b58f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:49:31.868348 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:49:31.868636 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:49:31.868915 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:49:31.870676 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:49:31.882591 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:49:31.884183 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:49:31.893842 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 628/1252] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:49:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:49:33.320759 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=57 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:49:41.889677 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=58 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:51:42.944417 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:51:42.945822 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:51:43.013894 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3917-bfdf-46c5-867c-71c8d6affd81 service placement] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:51:43.019577 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35657a86-b76c-490b-af87-704a8746370e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975c6f6b7fcd43ef83401317a46fc925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:51:43.020252 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657a86-b76c-490b-af87-704a8746370e service placement] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:51:43.020563 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657a86-b76c-490b-af87-704a8746370e service placement] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:51:43.020842 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657a86-b76c-490b-af87-704a8746370e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:51:43.022623 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-35657a86-b76c-490b-af87-704a8746370e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:51:43.033532 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35657a86-b76c-490b-af87-704a8746370e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:51:43.035121 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35657a86-b76c-490b-af87-704a8746370e service placement] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:51:43.044659 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 625/1253] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:51:42 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:51:53.040812 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=28 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:02.101752 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:52:02.122461 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a03cd-9d52-405c-83e4-71900e8843d5 service nova] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:52:02.125966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb78559-eed3-4ad1-b81d-69e913bafbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a31482a8d184d81a5569d11fcc53181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:52:02.126607 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb78559-eed3-4ad1-b81d-69e913bafbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:02.126910 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb78559-eed3-4ad1-b81d-69e913bafbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:02.127720 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb78559-eed3-4ad1-b81d-69e913bafbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:02.129753 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-8cb78559-eed3-4ad1-b81d-69e913bafbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:52:02.212045 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb78559-eed3-4ad1-b81d-69e913bafbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:52:02.213478 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb78559-eed3-4ad1-b81d-69e913bafbe1 service neutron] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:52:02.222897 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 629/1254] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:52:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:52:05.341437 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153124e7-b4cb-41b1-aa7c-79f7acef0e07 None None] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:05.341916 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153124e7-b4cb-41b1-aa7c-79f7acef0e07 None None] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:05.342012 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153124e7-b4cb-41b1-aa7c-79f7acef0e07 None None] PATH_INFO: `/` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:05.343426 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 626/1255] 10.222.0.94 () {54 vars in 921 bytes} [Fri Jul 15 15:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 15:52:05.368675 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] REQUEST_METHOD: `POST` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:05.369200 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:05.369576 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:05.403605 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.auth.core [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] MFA Rules not processed for user `975c6f6b7fcd43ef83401317a46fc925`. Rule list: `[]` (Enabled: `True`). {{(pid=87248) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 15:52:05.405169 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:52:05.417758 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 630/1256] 10.222.0.94 () {58 vars in 1018 bytes} [Fri Jul 15 15:52:05 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 15:52:05.440439 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153124e7-b4cb-41b1-aa7c-79f7acef0e07 None None] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:52:05.454379 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153124e7-b4cb-41b1-aa7c-79f7acef0e07 None None] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:52:05.460161 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '975c6f6b7fcd43ef83401317a46fc925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '703e07bc59894ec3ab0de167388fa57b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:52:05.460808 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] REQUEST_METHOD: `GET` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:05.461091 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:05.461365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:05.470003 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:52:05.472218 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:52:05.482191 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 627/1257] 10.222.0.94 () {60 vars in 1365 bytes} [Fri Jul 15 15:52:05 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 15:52:08.507024 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:52:08.508820 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:52:08.525428 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3b703-3e42-4a98-bfe2-63e661a69740 None None] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:52:08.530000 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:52:08.530872 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:08.531157 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:08.531432 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] PATH_INFO: `/v3/users/1e8435e43a1f456894554e40b8bb2271` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:08.532647 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8435e43a1f456894554e40b8bb2271)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:52:08.535114 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:52:08.581020 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8435e43a1f456894554e40b8bb2271'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.587932 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8435e43a1f456894554e40b8bb2271'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.600787 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8435e43a1f456894554e40b8bb2271'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.601505 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8435e43a1f456894554e40b8bb2271'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.609966 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8435e43a1f456894554e40b8bb2271'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.616907 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 631/1258] 10.222.0.94 () {58 vars in 1223 bytes} [Fri Jul 15 15:52:08 2022] DELETE /identity/v3/users/1e8435e43a1f456894554e40b8bb2271 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:52:08.802333 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:52:08.816402 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda95230-58b9-45c2-b004-ccf3cd9b6956 service placement] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:52:08.873291 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:52:08.874159 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:08.874448 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:08.874729 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] PATH_INFO: `/v3/projects/43a612d88d4b4bed8e7330fccb026834` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:08.875949 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a612d88d4b4bed8e7330fccb026834)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:52:08.877906 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:52:08.923427 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a612d88d4b4bed8e7330fccb026834', 'request_id': 'req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.931178 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a612d88d4b4bed8e7330fccb026834', 'request_id': 'req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.937203 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a612d88d4b4bed8e7330fccb026834', 'request_id': 'req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.947930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] The token cache is being invalidate because project 43a612d88d4b4bed8e7330fccb026834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:52:08.948224 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.948851 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:08.950378 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 628/1259] 10.222.0.94 () {58 vars in 1232 bytes} [Fri Jul 15 15:52:08 2022] DELETE /identity/v3/projects/43a612d88d4b4bed8e7330fccb026834 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:52:08.954325 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Authenticating user token {{(pid=87248) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:52:08.956281 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.fernet_utils [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87248) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:52:08.969399 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de460fb0-9ed5-4a6c-bc18-587fa49b86d5 admin admin] Validating token access rules against request {{(pid=87248) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:52:08.986018 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:09.028151 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87248) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:52:09.029021 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:09.029304 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:09.029577 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] PATH_INFO: `/v3/users/ca47edfe43534f08a9de100006cff21f` {{(pid=87248) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:09.030761 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca47edfe43534f08a9de100006cff21f)` {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:52:09.032738 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] RBAC: Authorization granted {{(pid=87248) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:52:09.078548 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca47edfe43534f08a9de100006cff21f'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.085779 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca47edfe43534f08a9de100006cff21f'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.098050 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca47edfe43534f08a9de100006cff21f'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.098691 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca47edfe43534f08a9de100006cff21f'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.105860 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG keystone.notifications [None req-6e2c8d5b-74f9-456a-b787-f4a6bbbe99f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca47edfe43534f08a9de100006cff21f'} {{(pid=87248) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.111823 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: [pid: 87248|app: 0|req: 632/1260] 10.222.0.94 () {58 vars in 1223 bytes} [Fri Jul 15 15:52:08 2022] DELETE /identity/v3/users/ca47edfe43534f08a9de100006cff21f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:52:09.284562 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Authenticating user token {{(pid=87247) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 15:52:09.286009 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.fernet_utils [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87247) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 15:52:09.303698 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c11fe-dcda-4155-93cf-538b5f1e0c93 admin admin] Validating token access rules against request {{(pid=87247) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 15:52:09.368863 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a5c2341cb2b4b2f93d951457ae1d5c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0448cce79e4a43eab947a52177358b0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87247) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 15:52:09.369732 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 15:52:09.370018 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 15:52:09.370324 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] PATH_INFO: `/v3/projects/2be3bfeeb43c453e8576fe9f362d835c` {{(pid=87247) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 15:52:09.371505 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be3bfeeb43c453e8576fe9f362d835c)` {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 15:52:09.373458 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] RBAC: Authorization granted {{(pid=87247) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 15:52:09.395898 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:09.421874 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be3bfeeb43c453e8576fe9f362d835c', 'request_id': 'req-c1b3be63-46c4-461e-a891-7713da16ad30'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.429828 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be3bfeeb43c453e8576fe9f362d835c', 'request_id': 'req-c1b3be63-46c4-461e-a891-7713da16ad30'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.435930 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be3bfeeb43c453e8576fe9f362d835c', 'request_id': 'req-c1b3be63-46c4-461e-a891-7713da16ad30'} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.447365 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] The token cache is being invalidate because project 2be3bfeeb43c453e8576fe9f362d835c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87247) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 15:52:09.447655 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.448343 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG keystone.notifications [None req-c1b3be63-46c4-461e-a891-7713da16ad30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87247) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 15:52:09.449886 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: [pid: 87247|app: 0|req: 629/1261] 10.222.0.94 () {58 vars in 1232 bytes} [Fri Jul 15 15:52:09 2022] DELETE /identity/v3/projects/2be3bfeeb43c453e8576fe9f362d835c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 15:52:19.108383 dv-osbrick-849840-2-ceph devstack@keystone.service[87248]: DEBUG dbcounter [-] [87248] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 15:52:19.444322 dv-osbrick-849840-2-ceph devstack@keystone.service[87247]: DEBUG dbcounter [-] [87247] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87247) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}